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PREFACE 
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research  of  the  Human  Performance  Center,  Department  of  Psychology, 
on  human  information  processing  stress  tactors , supported  by  i.r.e 
Office  of  the  Advanced  Research  Projects  .Agency,  under  Order  ..o.  --R  , 
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This  report  was  also  a dissertation  submitted  by  the  author  in 
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ABSTRACT 


Previous  studies  (Mayer  6 Greeno,  1972;  Grceno  S Mayer,  in  prepara- 
tion) have  suggested  that  teaching  Ss  to  solve  certain  kinds  Oi  problems 
by  different  instructional  methods  may  result  in  learning  outcomes  which 
differ  in  structural  or  qualitative  ways  as  indicated  by  a pattern  of 
treatment  x posttest  interaction  (TPI).  Two  new  questions  dealt  with 
in  this  dissertation  were:  (1)  How  can  the  acquisition  process  foi 

structurally  different  learning  outcomes  be  characterized?  (2)  Once 
established,  can  the  structure  of  learning  outcomes  be  altered  by 
post-experimental  manipulations  such  as  stress  during  testing. 

In  cuo  main  experiments,  the  concept  of  binomial  probability  was 
taught  to  S via  expository  four-lesson  teaching  booklets,  by  two  in- 
structional methods  that  differed  in  sequencing  and  emphasis.  One 
instructional  method  (Sequence  F)  began  each  lesson  with  a formal  state- 
ment of  the  rule  (or  sub-rule)  and  explained  component  variables  only 
within  the  context  of  calculating  with  the  formula;  the  other  method 
(Sequence  G)  began  each  lesson  by  attempting  to  relate  component 
variables  to  Sjs  general  experience,  e.g. , with  "trials,1  "outcomes," 
"successes,"  etc.,  before  presenting  any  formal  stateme.r:  of.the  rule. 
Learning  was  assessed  by  a multileveied  transfer  posttes.  which  con- 
tained both  near  and  far  transfer  items. 


To  provide  information  on  the  acquisition  question,  the  posttest 
was  administered  at  three  points  in  learning  for  S's  in  both  instruc- 
tional groups.  Some  Ss  were  tested  after  the  first  two  lessons 
( introduction  and  combinations),  some  after  three  lessons  (introduction, 
combinations,  joint  probability),  and  some  after  the  entire  four-lesson 
booklet  (introduction,  combinations,  joint  proba  Iity , and  binomial 
nrobability ) had  been  presented.  Both  Experiment  I and  Experiment 
used  this  procedure  although  the  ordering  of  booklet  lessons  differed. 

To  provide  information  on  the  resilience  question,  the  conditions 
of  testing  were  varied  with  some  S_s  in  each  instructional  group _ tested 
under  more  stress  than  others.  In  Experiment  I , the  stress  variable 
was  presence  or  absence  of  memory  support  during  testing.  In  Experimen 
II  the  stress  variable  was  presence  or  absence  of  time  stress  during 
testing.  Two  supplemental  studies  were  also  performed. 

The  main  results  with  respect  to  acquisition  were  the  following: 

(a)  The  overall  percent  correct  on  the  posttest  increased  for  both 
instructional  groups  as  the  amount  of  instruction  was  increased. 

(b)  The  same  treatment  x posttest  interactions  were  generally  found 
at  all  three  points  in  learning,  w' th  Sequence  F excelling  on  near 
transfer  items  and  Sequence  G excelling  on  far  transfer  items. 
there  was  no  evidence  of  any  structural  change  in  "what  is  learned 


vi 


as  learning  progressed.  (c)  The  combinations  lesson  was  far  more 
important  in  producing  increases  m posttest  performance  than 
joint  orobability  lesson.  However,  this  was  especially  true  for  the 
Ss  in  Sequence  F,  suggesting  that  Ss  in  Sequence  C were  better  able  to 
create  solutions  after  being  exposed  to  only  a part  of  the  material 
than  were  Ss  in  Seauence  F.  Findings  were  discussed  m coniur.cao, 
with  the  notion  that  different  kinds  of  existing  knowledge  were  ac- 
tivated early  in  learning  by  Ss  in  different _ instructional  poups  , 
and  that  those  different  sets  were  used  consistently  tnrougnouc 
learning  in  order  to  assimilate  the  content  material. 

The  main  results  with  respect  to  the  resilience  question  were 
the  following:  (a)  Stress  during  testing,  both  memory  load  and  time 

SeS,  had  In  overall  quantitative  effect  on  problem  solving  performance 
(b)  Test  stress  did  not  seem  to  alter  the  pattern  0 * . 

instructional  groups,  and  hence,  gave  no  evidence  of  altering  e 
structural  properties  o'  established  learning  outcomes,  Fadings 
were  discussed  in  relation  to  the  apparent  permanence  of  the  effec 
of  instructional  method. 
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CHAPTER  I 


INTRODUCTION 

There  has  been  much  written  about  the  importance  of  "how"  someone 
is  taught  to  solve  problems,  especially  mathematical  problems,  of  a 
given  class.  The  "how"  issue  has  often  centered  on  an  attempt  to  snow 
that  one  instructional  method  (e.g.,  "discovery  method")  is  better  or 
worse  overall  than  another  method  (e.g.,  "reception  method").  Witt  roc  .< 
(1966),  Hermann  (1969),  and  Mayer  (1972)  have  reviewed  this  line  of 
research;  and  in  1966,  Shulman  and  Keisler  edited  a book  entitled 
Learning  by  Discovery:  A Critical  Appraisal  which  summarized  much  of 
the  thinking  in  this  area. 

Since  that  time,  attention  seems  to  have  shifted  from  locating  the 
quantitative  effects  (i.e.,  "how  much"  is  learned)  of  how  material  is 
taught,  to  an  interest  in  the  cognitive  question  of  "what"  is  learned 
under  different  instructional  methods  (e.g.,  Roughhead  & Scandura , 

1968).  This  has  necessitated  an  analysis  of  S_' s cognitive  activity 
during  learning,  under  the  assumption  that  the  outcome  of  learning— 
"what"  is  learned--is  the  product  of  both  the  content  of  material 
presented  and  the  particular  assimilative  set  or  receptive  style  used 
to  encode  it . 

In  other  words,  as  the  pervasive  emphasis  on  "how  much"  is  learned 
under  different  instructional  methods  gives  way  to  the  question  of 
"what  kind"  of  learning  occurs,  the  need  for  an  understanding  of  the 
acquisition  process  and  especially,  of  the  role  of  S_' s internal  cognitive 
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activities  during  acquisition,  has  become  apparent.  At  least  two  kinds 
of  theories  of  the  acquisition  process  seem  possible.  (1)  A fairly 
simple  idea,  one  that  follows  from  "how  much"  questions,  is  that 
apparent  differences  in  what  is  learned  are  due  to  some  Ss  acquiring 
more  of  one  kind  of  content  and  less  of  another  relative  to  other  Ss. 

(2)  A more  complex  proposition,  one  that  most  theorists  interested  in 
"what  kind"  questions  seem  to  hold,  is  that  different  kinds  of  learning 
outcomes  are  due  to  acquisition  processes  in  which  content  material 
is  encoded  within  different  assimilative  sets  by  different  S_s.  Al- 
though the  first  proposal  requires  only  an  analysis  of  tne  amount  of 
material  presented,  most  recent  theories  have  relied  on  modified 
versions  of  the  second  proposal  in  which  s cognitive  activity  or 
set  as  well  as  the  material  presented  must  be  analyzed. 

For  example,  Rothkopf  (1970)  writes  of  the  influence  of  instructional 
method  on  S's  "mathemagenic  activities"  during  learning,  activities 
that  he  relates  to  such  concepts  as  set,  attention,  orienting  reflex, 
information  processing,  cognition,  and  rehearsal.  Rothkopt  (p.  325) 
argues:  "The  proposition  is  simple.  In  most  instructional  situations, 

what  is  learned  depends  largely  on  the  activities  of  the  student." 

Gagne  (1965,  1966)  has  outlined  a series  of  "internal  conditions" 
for  oroblem  solving  which  include  "search  an  ! select  .on"  of  existing 
knowledge.  He  has  suggested  that  "what  is  learned"  involves  both 
"external  events"  such  as  instructional  materials,  instructions,  and 
direction,  and  "internal  events"  such  as  the  nature  of  this  "trial 
and  erroi  ."  "hypothesis  selection,"  or  "search  and  selection"  activity. 
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Taking  a somewhat  different  approach,  Ausubel  (1961,  1968)  speaks 
of  S's  "learning  set"  and  suggests  that  learning  outcomes  are  determined 
both  by  "content  conditions"  (i.e.,  presentation  of  the  to-be-learned 
material)  and  "set  conditions"  (i.e.,  the  existing  structures  £ uses 
to  assimilate  the  content).  Ausubel  proposes  that  £ may  store  content 
material  in  either  a rote  or  meaningful  way  depending  on  £' s ability 


to  relate  subject  matter  content  to  existing  cognitive  structures, 
i.e.,  depending  on  whether  the  "content"  is  encoded  into  a "rote 
learning  set"  or  into  a wider  "meaningful  learning  set."  The  point 
is  summarized  as  follows  (1961,  p.  95):  "As  long  as  the  set  and  content 

conditions  of  meaningful  learning  are  satisfied,  the  outcome  should  be 
meaningful  and  the  advantages  of  meaningful  learning  (economy  of 
learning  effort,  more  stable  retention  and  greater  transferability) 
should  accrue  irrespective  of  whether  the  content  to  be  internalized 
is  presented  or  discovered,  verbal  or  nonverbal." 

This  general  theory  of  the  acquisition  process  has  been  summarized 
by  Mayer  & Greeno  (1972,  p.  165):  "...different  instructional  pro- 

cedures could  activate  different  aspects  of  existing  cognitive  structure. 
And  since  the  outcome  of  learning  is  jointly  determined  by  new  material 
and  the  structure  to  which  it  is  assimilated,  the  use  of  different 
procedures  could  lead  to  the  development  of  markedly  different 
structures  during  the  learning  of  the  same  new  concept. 

For  the  "how  much"  theories  of  the  acquisition  process,  there  is 
little  need  to  analyze  the  various  possible  kinds  of  cognitive  sets, 
since  it  is  the  amount  and  type  of  information  in  the  teaching  material 
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which  is  the  main  determinate  of  learning  outcome.  However,  a crucial 
question  for  the  "what  kind"  theories  is:  How  can  the  internal  cognitive 

set  and  activities  of  the  learner  be  characterized?  A number  of  defining 
factors  have  been  noted  with  respect  to  these  internal  events  during 
learning,  and  generally  the  distinctions  among  various  type:’  of 
internal  activity  during  learning  involve:  (l)  ^actively  participates 

in  the  discovery  of  the  to-be-learned  principle  or  material  vs.  G_ 
passively  receives  the  material  m final  form,  (2)  stores  and 
organizes  the  material  in  his  own  way  vs.  S_  stores  and  organizes  the 
material  as  E has  organized  it,  (3)  S_  assimilates  the  material  to  a 
wide  range  of  existing  cognitive  structures  vs.  S_ accomodates  his 
existing  structures  to  the  material,  (4)  acquires  a high  level, 
general  rule  or  strategy  vs.  S strives  to  acquire  discrete,  specific 

responses  to  specific  situations. 

Bruner  (1961,  p.  24)  in  his  classic  paper  entitled  "The  Act  of 

Discovery"  discusses  this  distinction,  especially  the  first  part  of  it, 

between  types  of  internal  events  during  learning: 

Very  generally,  ai  at  the  risk  of  oversimplification,  it  is 
useful  to  distinguish  two  kinds  of  teaching:  that  which. takes 

place  in  the  expository  mode  and  that  which  takes  place  in  the 
hypothetical  mode.  In  the  former,  the  decisions  concerning 
mode  and  pace  and"  style  of  exposition  are  principally  determined 
by  the  teacher  as  expositor,  the  student  as  listener. .. in  the 
hypothetical  mode  the  student  is  in  a more  cooperative  position 
' ' , the  student  is  not  a bench— bound  listener , but  is  taking  part 
In  the  formulation.  . .and  may  even  take  an  as  if  attitude. 

The  second  aspect  of  the  distinction  between  internal  activities 

is  reflected  in  Bower's  (1970)  separation  between  "experimenter-imposed 
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groupings"  (E-codes)  and  "subject-imposed  groupings"  (S-codes).  The 
assimilation-accomodation  component  of  the  distinction  (i.e.,  the  third 
part)  follows  with  slight  modification,  from  Piaget's  (1970)  original 
usages.  The  final  aspect  of  the  distinction  deals  with  S_'s  interpre- 
tation of  what  should  be  learned  as  discussed  by  Rosenthal  (i96o) 


and  Orne  (1962 ) . 

One  way  of  summarizing  the  possible  distinctions  m internal 
activity  or  set,  supposedly  evoked  by  different  instructional  methods, 
is  to  differentiate  the  degrees  to  which  S_  searchs  through  existing 
knowledge  in  order  to  map  presented  material  into  superordinate 
organizing  systems.  Unfortunately,  however,  although  it  is  the  theme 
of  many  a theory  there  are  very  few  experimental  studies  to  deal 
directly  with  the  relationship  among  instruction  method,  internal 

cognitive  activity,  and  learning  outcome. 

One  set  of  experiments  has  been  carried  out  by  Scandura  (1966, 
1967),  who  has  attempted  to  delineate  experimental  variables  influencing 
how  broadly  S encodes  mathematical  rules  or  algorithms.  For  example, 
in  a problem  solving  task,  Ss  given  the  solution  algorithm  in  con- 
junction with  very  specific  applications  performed  significantly 
better  on  near  transfer  items  than  Ss  not  given  the  algorithm,  but 
performed  significantly  worse  on  far  transfer  than  Ss  given  the 
algorithm  with  more  general  applications.  In  another  study, 
learning  problem  solution  rules  in  symbolic  notation  could  apply 
them  just  as  well  as  Ss  learning  the  same  rules  in  plain  English, 
only  if  they  had  received  pretraining  in  what  the  symbols  meant. 
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The  evidence  supports  the  claim  that  although  all  _5s  are  taught  the 
same  content  (i.e.,  problem  solving  rules),  internal  factors  such  as 
a broader  assimilative  "set"  do  influence  transfer  performance. 

In  another  study,  Gagne  and  Smith  (1962)  found  that  £s  who  were 
forced  to  verbalize  a rationale  for  each  step  during  learning  to  solve 
the  "disc  problem"  performed  significantly  better  on  transfer  to  harder 
problems  of  the  same  type  than  £s  who  did  not  verbalize  during  learning. 
Gagne  and  Smith  (p.  17)  state  the  influence  of  verbalization  on 
internal  cognitive  activity  as  follows:  "Requiring  verbalization 

somehow  forced  the  Ss  to  think." 

Such  findings  seem  to  support  the  idea  that  differences  in  what 
is  learned  are  due  to  differences  in  S_'s  assimixative  set  which  are 
activated  (at  least  in  part)  by  instructional  method.  However, 
techniques  for  producing  and  assessing  structural  or  qualitative 
differences  in  what  is  learned  have  not  been  well  developed,  and 
there  is  still  relatively  little  empirical  information  about  the 
acquisition  process. 

In  the  present  study  a technique  was  employed  that  was  developed 
‘n  Greeno’s  laboratory  (Mayer  6 Greeno,  1972;  Egan  6 Greeno,  1973; 
Greece  S Mayer,  in  Drop.)  which  seems  to  be  capable  of  producing  and 
assessing  structural  differences  in  learning  outcomes.  To  produce 
cualitiative  or  structural  differences  in  how  material  is  encoded 
and,  hence,  in  "what  is  1 carned"--rather  than  just  an  overall 
quantitative  effect — two  short,  expository  teaching  booklets  were 
developed  which  varied  the  emphasis  and  sequencing  of  instruction. 
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One  booklet  (Sequence  G)  attempted  to  activiate  S_’s  general 
experience  with  probability  situations— such  as  "trial,"  "outcome,” 
"success,"  "outcome  sequence,"  etc. — before  presenting  the  formula. 

The  other  booklet  (Sequence  F)  attempted  to  activate  S's  experience 
with  arithmetic  operations  and  calculating  with  £ formula  oy  begj.ni.-nig 
with  a statement  of  the  entire  formula  and  explaining  each  component 
variable  in  terms  of  how  it  fit  into  using  the  formula.  The  difference 
between  the  two  booklets  was  whether  the  formula  and  sub-formulas 
were  presented  before  (Sequence  F)  or  after  (Sequence  G)  discussions 
of  component  variables  and  whether  component  variables,  when  discussed, 
where  related  to  S’s  general  experience  (Sequence  G)  or  explained  only 

within  the  context  of  the  formula  (Sequence  F). 

Having  attempted  to  induce  differential  encoding  and  hence  qual- 
itatively different  learning  outcomes,  a multileveled  transfer  test 
consisting  of  both  near  and  far  transfer  items  was  used  to  assess  the 
structure  of  learning  outcomes.  The  reason  for  this  was  that  structurally 
different  learning  outcomes  could  be  inferred  from  a pattern  of  resul 
in  which  subjects  in  one  group  excell  on  some  kinds  of  posttest  items 
and  subjects  in  another  group  excell  on  other  kinds,  yielding  what 
• has  been  called  a treatment  x posttest  interaction  or  TPI. 

The  focus  of  the  present  experiments  was  on  two  questions.  The 
first  question  was  to  determine  how  the  structural  differences  in 
learning  outcomes  which  are  observed  at  the  end  of  learning  develop 
over  the  course  of  learning.  One  fairly  straightforward  possibility 
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is  that  Ss  in  ore  instructional  group  simply  learn  more  of  one  kind  of 
content  and  £s  in  another  instructional  group  learn  more  of  another  kind. 
A contrasting  view  takes  Sjs  internal  cognitive  set  or  encoding  style 
into  consideration  and  suggests  that  different  assimilative  sets  are 
activated  by  different  instructional  methods;  hence,  content  material 
is  encoded  differently  by  S_s  in  different  instructional  groups  and 
structurally  different  learning  outcomes  result. 

The  second  problem  was  to  determine  whether  the  cognitive  structure , 
once  established,  could  be  affected  by  testing  conditions  such  as  stress 
or  memory  support.  Such  manipulations  represent  an  attempt  to  force 
S_s  who  had  learned  by  different  instructional  methods  to  process 
existing  structures  in  the  same  way.  If  structural  differences 
"disappear"  under  these  circumstances,  the  importance  of  the  original 
teaching  method  set  in  establishing  the  structure  of  learning  outcomes 
would  be  diminished. 

In  order  to  provide  information  on  how  structural  differences 
develop  over  the  course  of  learning,  the  present  study  included 
between-subject  tests  for  TPI  at  three  points  during  learning--after 
presenting  approximately  one-third  (introduction  and  combinations 
lesson),  two-thirds  (introduction,  combinations  and  joint  probability 
lessons),  or  all  of  the  material  (introduction,  combinations,  joint 
probability  and  binomial  lessons).  Attention  was  to  be  paid  to 
results  suggesting  the  nature  of  the  acquisition  process  which  pro- 
duces structurally  different  learning  outcomes,  especially  results 
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distinguishing  (1)  a process  of  adding  more  and  more  content  material 
of  different  kinds  under  the  two  instructional  methods,  from  (2)  a 
process  of  embedding  material  in  different  assimilative  sets  under 
the  two  treatments. 

In  order  to  provide  information  on  how  structural  dirrerences 
nersist  once  they  have  been  established,  the  present  study  varied 
the  amount  and  kind  of  stress  during  testing.  Attention  was  paid  to 
results  suggesting  whether  subjects  who  have  structured  a problem- 
solving rule  in  different  ways  can  be  forced  to  process  this  knowledge 
in  the  same  way.  This  question  was  tested  by  comparing  the  pattern 
of  TPI  produced  by  Ss  from  both  instructional  groups  who  are  tested 
mder  stress  with  Ss  tested  without  stress. 


CHAPTER  II 


EXPERIMENT  I 


This  study  attempted  to  assess  the  consequences  of  varying  the 
sequencing  and  amount  of  instruction  for  a mathematical  concept,  and 
the  amount,  of  stress  during  testing.  In  each  instructional  sequence, 
Ss  were  given  varying  amounts  of  instruction.  All  Ss  took  the  same 
30-item  posttest,  containing  several  kinds  of  test  items,  and  the 
condition  of  testing  was  varied. 


Method 


Subjects  and  Design 

Subjects  were  117  University  of  Michigan  students  who  had  volunteered 
to  participate  in  psychological  experiments  at  the  Human  Performance 
Center  for  pay.  Mine  Ss  served  in  each  cell  ofa  2x3x2 
factorial  design,  with  a thirteenth  group  of  Ss  serving  as  controls. 

The  first  factor  that  was  varied  was  the  emphasis  and  sequencing 
of  instruction.  Some  Ss  (Sequence  F)  learned  the  binomial  distribution 
concept  by  a method  that  begat  with  a statement  of  the  formula  and 
explained  the  variables  of  the  formula  in  relation  to  the  mechanical 
ooerations  involved.  Other  Ss  (Sequence  G)  received  a teaching 


-ooklet  that  related  the  variables  of  the  formula  to  concepts  that 
,s-«re  presumably  part  of  S_’s  general  knowledge  and  then  presented 

the  formula. 

The  second  factor  that  was  varied  was  the  amount  of  instruction. 
Each  teaching  booklet  was  divided  into  four  parts  consisting  of  an 
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introduction  (Part  I),  a lesson  on  combinations  (Part  II),  a lesson 
on  joint  probability  (Part  III),  and  a lesson  on  binomial  probability 
(Part  IV).  Some  S_s  (Amount  I)  received  just  Part  I and  Part  II; 
some  Ss  (Amount  II)  received  Parts  I,  II,  and  III;  and  some  Ss 
(A.uount  III)  received  all  four  parts.  In  Experiment  I,  all  Ss  re- 
ceived the  booklets  in  the  order  described  above,  namely  introduction 
followed  by  combinations  followed  by  joint  probability  followed  by 
binomial  probability  (Ordering  ABC).  (In  Experiment  II,  all  Ss 
received  the  booklets  with  the  positions  of  the  combinations  and 
the  joint  probability  parts  reversed.  Ordering  BAC.) 

The  third  factor  that  was  varied  in  Experiment  I was  the  presence 
or  absence  of  memory  support,  a sort  of  stress  relief,  during  the 
transfer  test.  Some  Ss  (Condition  Memory  Support)  were  allowed  to 
refer  to  their  teaching  booklets  during  the  test,  while  other  Ss 
(Condition  No  Memory  Support)  were  r.ot.  In  Experiment  I,  all  Ss 
were  allowed  as  much  time  as  necessary  to  complete  the  test  (Condition 
No  Time  Stress). 

Materials 

The  two  instructional  sequences  (Sequence  F and  Sequence  G) 
were  incorporated  into  two  four-part  typewritten  booklets  with  six 
to  eight  pages  in  each  booklet.  The  lessons  were  converted,  with 
slight  revision,  from  the  CAI  frames  used  by  Greeno  and  Mayer  (in 
prep.).  Both  groups  learned  the  concept  expressed  by  the  formula, 

P(R,N)  = C(N,R)  x PR  x (1-P)N_R 


1? 


f trials  R Is  the  number  of  successes,  P 
'here  H is  the  number  of  trials,  _ . a , 

C(u  p)  is  the  number  of  combma  ‘-o 
;he  probability  of  success,  CCM.PJ 

Kahili tv  of  R successes  in  N tixdls. 
p (R,H)  is  the  probability 

, in  the  booklet  for  Sequence  G were: 

The  Ideas  expressed  anc, 

nart  T (production):  Introduction  and  cxampl  • 

"success introduction  and 
-outcome,”  introduction  and  example  - 

role  o"  "probability  of  success,"  introduction  and  exampl 

. . f failure,"  introductiou  and  example 

"failure"  and  "probability  of  failu  _ 

„ .equence"  and  "probability  of  a sequonoe , 
of  outcome  sequence 

notation  for  N and  R.  trials ," 

Part  H (Combinations,:  Re-introduction  of 

cs  " and  outcome  "sequence-,"  example  of  hov,  to 

"humber  Of  successes,  an  ii  = 3 and  R = 2;  verbal 

aerate  number  of  combinations  it  of  cW,R)l 

. p -number  of  combinations, 

dafinitl0l  0 elating  verbal  explanation  of  bo»  to  generate  combin- 
t„o  examples  in  usi„g  tbe  formula  for  » " K 

at ions  to  the  operations 

R = 1 and  » = 5,  R = 3.  Ro.introduction  of  "trial,” 

Part  III  (Joint  Probability):  Re 

ce  " and  "probability  of  success:"  example  of 
"outcome,"  "sequence,  and  . 

re  feint  probability  for  a H term  sequence, 
how  to  generate  1°  . 5 and  6 term 

- how  to  venerate  joint  probabili  y 
oxa moles  oi  . ..  . . introduction 

, their  relation  to  the  formal  definition, 

“ p and  p.p.,  another  5 term  example  relating  generated 

"^-crmal  definition:  stated  of  — 
point  probabilitv 

o sN-R 

of  pR  x (1-P) 


definition 
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Part  IV  (Binomial  Probability):  Introduction  and  verbal  definition 

of  bionomial  probability;  re-introduction  of  "probability  of  a sequence" 

R 

and  "number  of  combinations;"  formal  definition  of  C(N,R)  x P x 

R N— R 

(]-P)H"R;  example  of  how  to  use  formula,  ?(R,N)  = C(h:,R)  x ? x (1-p) 

The  ideas  expressed  in  the  booklet  for  Sequence  r were: 

Part  I (Introduction):  Introduction  of  formal  definition  tor 

binomial  probability  as  P(R,N)  = C(N,R)  x P"  x (1-P)  R ; explanation 
and  example  of  formula  as  finding  the  probability  of  R successes  in 
N trials;  restatement  of  formula  and  explanation  of  P(R,N)  as  product 
of  C(N,R),  PR  and  (1-P)N_R;  verbal  definition  of  C(N,R),  R,  p»  (-L"P^  » 
and  (H-R). 


Part  II  (Combinations):  Restatement  of  formula;  re-introduction 

of  C(N,R)  as  first  major  step  in  calculating;  formal  definition  of 

C(H,R)  as  N ! / ( R!  x (N-R)!);  enumeration  of  steps  to  calculate  C(N,R)» 

two  examples  of  steps  to  calculate  for  N = 4,  R = 1 and  N=  5,  R = 3. 

R 

Part  Ilia  (Joint  Probability  - PR  Term):  Re-introduction  of  P‘ 

as  second  major  step  in  calculating  with  the  formula;  verbal 

R. 

definition  and  example  of  P;  enumeration  of  steps  to  calculate  ; 
two  examples  of  steps  to  calculate  for  specific  values. 

Part  IHb  (Joint  Probability  - (1-P)N'R  Term):  Restatement  of 

formula;  re-introduction  of  (1-P)N_R  as  the  third  major  step; 
enumeration  of  steps  to  calculate  (l-P)N  R and  example;  verbal 
statement  of  P as  probability  of  success,  (1-P)  as  probability  of 
failure,  R as  number  of  successes,  with  N-R  as  number  of  failures; 
two  examples  of  steps  to  calculate  (1-P)N  R for  specific  values. 
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Part  IV  (Binomial  Probability):  Restatement  of  formula;  restate- 

ment of  steps  to  calculate  P(R,N)  as  calculating  C:!J,R),  calculating 
PP',  calculating  (1-P):'I_R,  and  finding  the  product  of  these  three 
values;  two  examples  for  specific  values. 

All  examples  were  presented  either  in  terms  of  N,  R and  P or  a 
die  rolling  situation,  and  an  attempt  was  made  to  present  both  groups 
with  the  same  examples.  The  two  booklets  are  reproduced  in  Appendix  A. 

A test  set  consisted  of  30  typewritten  cards  representing  five 
problem  types,  two  problem  formats,  and  three  problem  content  areas. 

The  5x2x3  design  yielded  30  cells,  each  represented  in  one  of 
the  30  test  items. 

The  first  transfer  dimension  was  the  type  of  test  item.  Familiar 
problems  (F-type)  were  presented  in  the  same  way  as  example  problems 
during  training;  transformed  problems  (T-type)  required  a transfor- 
mation, usually  of  an  algebraic  nature,  to  be  put  into  familiar  form; 
so-called  Luchins  problems  (L-type)  presented  a complicated  looking 
situation  which  could  be  solved  quite  easily  if  would  take  a moment 
to  "think;"  question  items  (0-type)  asked  a question  about  the  variables 
in  the  formt'la  rather  than  requiring  a solution  value;  and  unanswerable 
problems  (U-type),  although  looking  very  much  like  Type  F problems, 
oresentea  either  insufficient  or  inconsistent  information. 

The  second  dimension  was  format  of  test  problems.  Formula  problems 
(F-format)  were  stated  in  terms  of  N,  R and  P — the  formal  notation 
k used  in  presenting  the  formulae  in  the  teaching  booklets;  story 
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problems  (S- format)  were  stated  in  terms  of  some  situation  not  dis- 
cussed in  the  teaching  booklets  such  as  sampling  peanuts  from  a barrel 


in  which  some  proportion  is  rotten. 

The  third  dimension  was  the  content  of  test  problems.  Combina- 
tions problems  (C-content)  asked  for  or  dealt  with  C(X,R)  or  tr.e 
number  of  combinations;  joint  probability  prooiems  (c -content)  aor.ea 
for  or  dealt  with  PR  x (l-P)N_R  or  the  probability  of  a specific 
sequence;  binomial  probability  (B-content)  asked  for  or  dealt  with 
the  theme  of  the  teaching  booklets,  finding  P(R,N^  or  the  probability 
of  R successes  in  N trials. 

Examples  of  the  test  problems  and  answers  are  given  below: 
Familiar  Type,  Formula  Format,  Binomial  Content:  N = 4,  R - 3, 

P - .20.  What  is  P(R,N)?  The  correct  answer  requires  plugging  the 


values  of  N,  R and  P into  the  formula  to  get, 

p(R,N)  = C(4 ,3)  x (.20)3  x (.80)1  = 16/625. 

Transformed  Type,  Formula  Format,  Joint  Content:  P = 3(1-P), 

N = 6,  R = N-R.  What  is  PR  x (1-P)N_R?  The  correct  answer  requires 

solving  for  P and  R before  plugging  into  the  joint  probability 

formula  to  get, 

PR  x (1-P)M_R  = ( 3/4)3  x (1/4)3  = 27/4096. 

Luchins  Type,  Story  Format,  Combinations  Content:  There  are  10 

different  sequences  that  have  exactly  two  successes.  All  the  sequences 
have  the  same  length.  How  long  are  they?  The  correct  answer  requires 
finding  a value  of  N to  fit  C(N,R)  = 10  and  R = 2 , as  shown: 
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Question  Type,  Story  Format,  Binomial  Content:  Is  there  a 

difference  between  the  probability  that  two  dice  rolled  at  once  both 
come  ud  6 and  the  probability  that  one  die  rolled  twice  comes  up  L 
both  times?  The  answer  requires  an  understanding  of  independence 
oi  events;  hence  the  subject  should  answer  "no"  or  "no  difference." 

Unanswerable  Type,  Story  Format,  Combinations  Content:  How  many 

different  sequences  have  the  same  number  of  successes  as  failures? 

The  answer  requires  the  recognition  of  insufficient  information, 
i.e.  , no  value  of  N is  given,  and  hence  the  correct  answer  is  "no 
answer. " 

The  entire  test  set  is  reproduced  in  Appendix  B. 

Additional  materials  used  in  the  experiment  were  a subject  record 
consisting  of  questions  to  determine  the  extent  of  Sj  s experience 
in  statistics  and  probability,  and  a pretest  designed  to  determine 
whether  £ had  sufficient  computational  skill  to  master  the  material 
in  the  teaching  booklets.  The  pretest  consisted  of  10  items:  2 

dealt  with  factorials  (e.g.  , 5!  =5x4x3x2xl  = );  4 dealt 

with  exponentiation  of  fractions  or  decimals  (e.g.,  (1/4)  = ); 

and  4 dealt  with  multiplication  of  fractions  or  decimals  (e.g., 

2/3  X 1/4  = ). 

Procedure 

Subjects  we  re  run  in  small  groups  averaging  four  per  session. 
First,  the  subject  record  and  pretest  were  administered.  Subjects 
indicating  no  relevant  experience  with  the  binomial  but  making  no  more 
than  3 computational  errors  were  randomly  assigned  to  treatment  groups. 
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The  £ read  the  instructions  and  again  asked  £ to  indicate 
familiarity  with  the  binomial.  Then,  each  £ was  given  the  appropriate 
teaching  booklet. 

Subjects  were  instructed  to  read  their  booklets  silently  sr.d 
at  their  own  rate  and  to  try  to  understand  the  explanations  and 
examples.  Subjects  were  allowed  to  take  notes  or  figure  on  a blank 
sheet  of  paper.  Subjects  were  told  that  they  would  have  20  minutes, 
and  all  £s  finished  within  that  limit.  Subjects  who  finished  earlier 
were  asked  to  sit  quietly  until  the  test  began. 

Immediately  following  the  reading  period,  E collected  the 
teaching  booklets  and  notes  (except  for  Condition  Memory  SuDDort  Ss ) , 
read  the  instructions  for  the  test,  and  wrote  the  formula  for  P(R,>.:) 
on  the  chalk’  oard.  Each  £ was  given  a pile  of  30  problem  cards  face 
down,  and  a blank  answer  sheet.  On  £’ s signal  S was  to  turn  ud  the 
first  card,  copy  its  code  number,  show  his  work  and  circle  his  final 
answer,  and  then  go  on  to  the  next  card.  There  was  no  time  limit 
but  all  £s  were  told  that  once  they  began  a new  card  they  could  not 
go  back  to  work  on  any  previous  card.  All  Ss  were  told  to  write 
"no  answer"  if  they  felt  a problem  was  unanswerable. 

Nine  different  orders  of  presenting  the  test  cards  were  constructed. 
The  orders  were  random  except  for  the  constraint  that , of  the  nine 
orderings,  each  item  had  to  appear  in  the  first  one-third  (i.e., 

I through  10)  in  three  of  the  sets,  in  the  second  one-third  (i.e., 

II  through  20)  in  another  3 of  the  sets,  and  in  the  last  one-third 
(i.e.,  21  through  30)  in  the  other  3 sets. 
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After  the  test,  Ss  were  paid  and  informally  questioned  by  E. 

Mo  Ss  who  participated  in  the  experiment  indicated  previous  familiarity 
with  the  material  at  this  time. 

Results  and  Discussion 

In  Experiment  I,  five  Ss  failed  to  receive  a score  of  seven  or 
more  on  the  pretest,  four  Ss  expressed  direct  familiarity  with  the 
material  in  the  teaching  booklets,  and  two  failed  to  properly  follow 
directions.  These  Ss  were  eliminated  from  the  experiment  and  new  Ss 
were  run  in  their  places. 

The  performance  on  the  transfer  test  was  scored  with  each  item 
marked  either  correct  or  incorrect.  Answers  were  marked  correct  if 
thev  were  in  proper  form  even  though  computation  may  ha-  e been  incorrect 
or  not  carried  out.  The  control  Ss  performed  at  very  low  levels, 
i.e.,  an  average  of  less  than  10%  correct,  thus  indicating  that  the 
experimental  treatments  had  a substantial  effect.  An  analysis  of 
variance  was  performed  on  the  data  of  all  experimental  Ss.  There 
was  only  a marginal  difference  in  the  overall  performance  of  the 
two  experimental  groups  (F_  = 2.02,  if  = 1/96,  v_  < .100),  thus 
frustrating  the  question  of  "which  method  is  best." 

2.0 c f 2.1.  ^ ^ ^proncp? 

In  earlier  studies,  where  Ss  were  tested  after  receiving  the 

entire  booklet,  there  was  evidence  for  inferring  that  Ss  in  different 
instructional  groups  had  acquired  learning  outcomes  which  differed 
in  a structural  or  qualitative  way  (Mayer  6 Greeno,  1972  ; Egan  6 


19 


• ^ rii*‘piip"t'iir'3Xlv  cliffsi'sn't  lssFriing 

Greeno,  1073;  Greeno  t Mayer,  in  prep.),  structurally 

outcomes  could  be  Interred,  i was  argued,  if  Ss  in  one  treatment  con- 
dition excelled  on  certain  kinds  of  posttest  (i.e.,  transfer  te 
problems  and  subjects  in  another  treatment  condition  excelled  on 
other  kinds  of  posttest  problems.  Thus  the  inference  of  structural 
differences  between  learning  outcomes  is  based  on  wnat  has  been  cal 
a treatment  X posttest  interaction  or  TPI-  a disorcm 
(Bracht,  1070)  between  treatment  condition  (e.g.,  sequencing  of 
instruction)  and  kind  of  posttest  item  (e.g.,  format,  type  or  content). 

in  the  present  experiment,  a comparison  of  Ss  in  the  two  instruc- 
tional sequence  groups  who  received  Amount  III  reveals  the  same 
general  pattern  of  TPI  as  produced  in  previous  studies.  The  right 
panels  of  figures  1,  2,  and  3 show  that  Ss  in  Sequence  F who  received 
the  entire  booklet  excelled  on  near  transfer  problems  such  as  F-format 
(formula),  F-type  (familiar),  and  B-oontent  (binomial),  while  Ss  in 
Sequence  G excelled  on  far  transfer  problems  such  as  F-format  (story), 

Q-  and  U-type  (question,  unanswerable),  and  C-  and  J-content 

, ,n:tv)  These  TPIs  indicate  that  differences 
(combination,  joint  probability).  These 

in  the  structure  of  learning  outcomes  have  been  produced. 

A major  new  question  asked  in  the  present  experiment  is:  How 

do  the  structural  differences  in  learning  that  are  observed  at  the 

end  of  the  lesson  develop  over  the  course  of  learning?  This 

. . „ , least  two  possible  answers  of  theoretical 

"acquisition  question"  has  at  least  two  v 

interest.  One  possibility  is  that  over  the  course  of  learning  Ss  m 
one  group  are  acquiring  more  of  one  kind  of  content  while  Gs  in  another 
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group  are  acquiring  more  of  another  kind  of  content.  This  process  should 
manifest  itself  as  an  even  increase  in  overall  Performance  bv  both  groups 
accompanied  by  a gradual  emergence  of  TPI , being  very  weak  early  in 
learning  where  little  content  has  been  presented  and  strong  at  the  end 
where  the  maximum  differences  in  content  are  possible.  A second  possi- 
bility is  that  the  general  organization  and  emphasis  of  each  testing 
sequence  encourages  the  activation  of  different  kinds  of  assimilative 
sets  very  early  in,  and  across  all,  learning.  This  process  should 
manifest  itself  either  as  a difference  in  overall  performance  early 
in  learning  that  disappears  by  the  end  or  as  a fairly  strong  and  con- 
sistent TPI  at  all  points  in  learning,  at  the  beginning  as  well  as  the 
end  of  the  lesson. 

In  order  to  provide  some  data  on  this  question,  posttesLa  were  ad- 
ministered at  three  distinct  point  in  learning:  After  Amount  I for 
some  Ss , after  Amount  II  for  other  Ss , and  after  Amount  III  for  other  Ss . 

As  could  be  expected,  a significant  overall  effect  due  to  amount  of  in- 
struction was  found  (F_  = 4.49,  df  = 2/96,  p_  < .025),  suggesting  that 
adding  more  sections  increased  performance  for  both  instructional  sequences. 

Before  presenting  the  various  figures  concerning  treatment  x post- 
test interaction,  it  should  be  noted  that  the  x-axis  of  each  graph  is 
a continuum,  representing  the  degree  of  transfer,  only  in  a very  general 
sense.  Although  an  attempt  has  been  made  to  place  near  transfer  tasks 
on  one  side  (e.g.  , familiar  type  on  the  left)  and  interpretive,  far 
transfer  tasks  on  the  other  (e.g.,  unanswerable  and  question  types  on 
the  right),  in  some  cases  the  ordering  is  arbitrary  (e.g.,  the  respective 
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placements  ot  O-type  and  U-type,  cr  of  C-content  and  J-content).  Thus 
the  lines  connecting  the  dots  are  included  to  aid  in  presenting  the  data 
and  in  making  comparisons  across  panels,  but  should  not  be  interpreted 
as  suggesting  a strict  continuum  for  degree  of  transfer  that  would  allow 
interpolation  between  points  or  judgments  based  on  the  absolute  shape 
of  the  lines. 

Figure  1 shows  the  instructional  sequence  by  problem  format  inter- 
action after  each  amount  of  instruction.  The  two-way  interaction  between 
sequencing  and  format  is  reliable  (F  = 14.72,  df  = 1/96,  £_  < .001)  m 
dicating  structural  differences  in  what  was  learned.  As  can  be  seen, 
this  TP I is  clearly  evidenced  in  all  three  panels  of  Figure  1 and 
there  is  no  reliable  sequence  by  amount  by  format  interaction  (r_  - 1.30, 
df  = 2/96,  p > .20)  required  to  reject  the  hypothesis  that  TP I is  the 
same  at  each  point  in  learning.  Although  the  performance  of  each  se- 
quence group  reliably  increased  overall  from  Amount  I to  Amount  II  to 
Amount  III,  the  absence  of  an  amount  by  format  interaction  suggests  a 
proportional  quantitative  increase  for  both  problem  formats  rather  than 
a structural  change  as  the  amount  of  instruction  was  increased. 

Figure  2 shows  the  instructional  sequence  by  problem  type  interaction 

after  each  amount  of  instruction.  The  two-way  interaction  between  se 

. , • 1,  /r  _ c oa  df  = 4/384,  d < .001),  again 

quencing  and  type  is  reliable  (IF  - 6.28,  a *- 

suggesting  structural  differences  similar  to  those  found  in  earlier 

studies.  As  can  be  seen,  even  after  Amount  I there  is  evidence  of  this 

characteristic  TPI  with  Sequence  F slightly  ahead  for  F-type  and  Se 

quence  6 superior  on  Q-  and  U-type.  This  pattern  seems  fairly  consistent 

across  all  three  amounts  of  instruction  and  there  is  no  reliable  treatment 
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rig.  2.  Proportion  correct  response  for  two  instructional  groups  by  problem  type  for  three  amounts  of 

instruction-- Experiment  I.  The  abscissa  roughly  represents  th  degree  of  transfer  constituted  as  follow 
F-type  (familiar)  and  T-tvpe  (transformed)  represent  near  tram  fer  tasks,  while  L-type  (Luchins)  repre- 
sents intermediate  transfer,  and  U-type  (unanswerably  and  Q-type  (question)  represent  far  transfer. 
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by  t'/De  by  amount  interaction  (F_  = 1.03,  df  = 8/384,  p_  > .20)  required 
to  reject  this  hypothesis.  Although  the  performance  of  each  treatment 
group  reliably  increased  overall  from  Amount  I to  Amount  II  to  Amount  III 
there  is  no  reliable  amount  by  type  interaction  (F_  = 1.05,  df  = 8/384, 
p > ,2c)  again  suggesting  that  the  increase  is  proportional  across  all 
problem  types.  These  findings  are  consistent  with  the  notion  that  the 
structure  of  learning  outcomes  remains  constant  across  all  three  amounts 
of  instruction. 

Figure  3 shows  the  sequence  by  problem  content  interaction  after 
each  amount  of  instruction.  The  two-way  interaction  between  sequence 
and  content  is  significant  (F_  - 10.19,  df  = 2/192,  p_  • .001)  again  in- 

dicating a difference  in  the  structure  of  what  was  learned.  As  can  be 
seen,  this  TPI  is  hinted  after  Amount  I,  but  does  not  become  strong  until 
after  Amount  II  and  III.  However,  there  is  no  reliable  treatment  by 
content  by  amount  interaction  (£  = 1.77,  df  ~ 4/192,  p_ > .15)  thus 
it  is  not  possible  to  reject  the  notion  that  the  structural  differences 
among  the  instructional  groups  remain  constant  at  each  of  the  three 
points  in  learning  that  were  tested.  A reliable  amount  by  problem 
content  interaction  (F  = 2.54,  df  = 4/192,  p * .050)  suggests  that, 
not  only  did  performance  increase  overall  with  the  addition  of  more 
sections,  but  it  also  increased  disproportionately  more  as  might  be 
expected--on  the  content  of  the  material  covered. 

In  summary,  the  three  possible  sequence  by  posttest  by  amount  inter- 
actions represent  three  separate  tests  of  the  "acquisition  question." 

In  all  three  cases  there  is  reliable  two-way  TPI,  but  there  is  no  evi- 
dence of  any  difference  in  TPI  among  Amount  I,  Amount  II,  and  Amount  HI 
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Fig.  3.  Proportion  correct  response  for  two  instructional  groups  Ly  problem  content  for  three  amounts  of 
instruction--Experiment  I.  The  abscissa  roughly  represents  the  degree  of  transfer  constituted  as 
follows:  B-content  (binomial)  represents  near  transfer,  and  C-con'ent  (combination)  and  J-content 

(joint)  represent  far  transfer. 


These  results  suggest  that  structural  differences  occur  earlv  in  learning 
and  remain  fairly  constant  throughout. 

In  previous  attempts  to  describe  the  structural  differences  in  what 
is  learned  by  subjects  in  different  instructional  groups  it  has  been 
useful  to  postulate  two  dimensions  of  cognitive  structuring — internal 
connectedness  and  external  connectedness.  Internal  connectedness  refers 
to  the  degree  to  which  the  variables  of  the  formula  are  related  to  one 
another  in  S_'s  cognitive  structure,  e.g.,  P is  related  to  R by  exponen- 
tiation. Fxternal  connectedness  refers  to  the  degree  to  which  variables 
of  the  formula  are  related  to  knowledge  already  existing  in  S's  cognitive 
structuring,  e.g.,  P is  related  to  past  experience  with  probability  such 
as  weather  forecasts  (20%  chance  of  rain),  dice  (each  number  has  1/6 
probability),  batting  average  (.333  means  the  batter  gets  a hit  1/3  of 
his  times  at  bat). 

In  the  present  situation,  there  is  evidence  that  Sequence  F Ss 
developed  structures  with  strong  internal  connectedness  but  weak  external 
connections  while  Sequence  G S.s  developed  structures  with  strong  external 
connectedness  but  weak  internal  connections.  This  hypothesis  is  consistent 
with  observed  TPI  (with  each  of  the  three  posttest  dimensions)  which 
generally  showed  that  Sequence  F Ss  excel  on  near  transfer  items  which 
require  an  exact  application  of  the  formula,  and  that  Sequence  G Ss 
excel  or  "ar  transfer  items  which  require  a more  sophisticated  under- 
standing and  interpretation  of  the  component  variables. 

The  present  study  adds  some  information  on  how  these  different 
structures  develop.  The  results  of  the  present  study  seem  consistent 
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with  the  notion  that  different  receptive  sets  are  activated  early  in 
learning.  Furthermore,  the  differences  in  how  the  material  is  encoded 
are  established  early  and  remain  constant  throughout  learning.  Greeno 


(1972)  provides  a framework  for  analyzing  problem  solving  behavior 
which  relies  on  a distinction  between  two  kinds  of  knowledge  stored 
semantic  memory— "propositional  knowledge"  and  "algorithmic  knowledge." 
Propositional  knowledge  refers  to  relational  and  conceptual  information 
such  as  hierarchies  of  classes  and  subsets  (collies  are  dogs),  proper- 
ties of  classes  of  things  (dogs  have  tails),  and  facts  (April  17  - 23 
is  national  Dog  Week).  Algorithmic  knowledge  refers  to  rules  or 
operations  such  as  the  procedures  followed  in  doing  "long  division." 

In  the  present  example,  it  seems  that  the  organization  and  emphasis 
of  Sequence  F encourages  the  use  of  a narrow,  assimilative  set  concerned 
with  mathematical  operations  and  calculations-what  could  be  called 
algorithmic  knowledge— and  that  Sequence  G encourages  the  activation 
of  a broader,  more  integrative  set  made  up  of  S_' s general  experience— 
what  could  be  called  propositional  knowledge.  Since  what  is  learned  is 
the  product  of  both  the  presented  material  and  the  assimilative  set  S_ 


uses  to  encode  it,  different  learning  outcomes  are  possible.  What 
these  results  seem  to  show  is  that  the  algorithmic  kind  of  set  is 
activated  quite  early  in  learning  for  Sequence  F and  the  propositional 
kind  of  set  is  activated  quite  early  in  learning  for  Sequence  3,  further 
there  is  support  for  the  idea  that  the  structural  differences  observed 
at  the  end  of  learning  have  their  roots  in  this  embedding  of  material 
into  two  different  kinds  of  assimilative  sets  or  knowledge  which  begins 
early  and  continues  throughout  learning. 
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Resilienc  of  Structural  Differences 

A second  new  question  asked  by  the  present  experiment  was:  Once 

structural  differences  have  been  established  by  different  instructional 
methods,  can  'iPI  be  disrupted  by  testing  conditions  that  vary  the  amount 
of  stress  during  testing?  This  "resilience  question"  depends  on  an 
attempt  to  create  testing  conditions  that  could  force  £s  in  different 
Instructional  groups  (and  hence  with  different  learning  outcomes)  to 
process  their  cognitive  structures  in  the  same  wav  and  thus  eliminate  TPI. 

This  question  is  of  interest  because  it  gives  some  information  about 
the  permanence  of  effects  generated  by  teaching  method.  If  structural 
differences  appear  during  and  immediately  after  learning,  as  has  been 
shown,  but  "disapnear"  or  are  strongly  influenced  by  testing  condition, 
then  the  long  range  importance  of  what  method  is  used  can  be  minimised. 

In  this  case,  instructors  could  rely  on  post-learning  manipulations  to 
alter  the  structure  of  learning  outcomes.  However,  if  varying  testing 
conditions  fail  to  alter  the  characteristic  pattern  of  TPI,  this  would 
orovide  more  evidence  for  the  importance  of  selecting  an  appropriate 
teaching  method.  Such  results  would  suggest  that  postlearning  manipulations 
tc  process  learned  material  in  a certain  way  have  negligible  effect  or. 
the  structure  of  outcome  performance. 

In  Experiment  I,  the  testing  variable  of  "memory  support"--a  sort 
of  stress  relief — was  used.  Subjects  in  the  memory  support  condition 
had  their  teaching  booklets  available  for  reference  and  the  binomial 
formula  on  the  blackboard  during  the  test  while  £s  in  the  no  memory 
supnort  condition  had  only  the  formula  on  the  blackboard. 
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The  performance  for  the  two  sequence  groups  under  memory  support  and 
no  memory  support  conditions  is  piven  by  problem  format  m iipurc  4,  by 

problem  type  in  Figure  5,  and  by  problem  content  in  Figure  6.  As  can  ae 
seen  by  comparing  the  right  and  left  panels  of  each  figure,  "open  book- 
testing seems  to  have  helped  to  slightly  increase  posttest  scores  overall 
for  both  instructional  groups,  although  the  increase  failed  to  reach  a 

statistically  significant  level  (F  = 1-44,  df  = 1/96,  £>  -20). 

For  both  instructional  groups  there  was  some  hint  that  memory 
support  helped  to  disproportionately  increase  perforrrance  on  harder 
problems — "far"  transfer  items-especially  for  S-format  relative  to 
F- format  items.  Marginally  significant  type  by  testing  condition 
(F  = 2.12,  df  = 4/334,  £ < .100),  format  by  testing  condition  (F  - 4.79, 
df  = 1/96,  P < -050),  and  content  by  testing  condition  (F  - 2.57, 
df  = 2/192,  p < .100)  interactions  offer  only  weak  support  for  this 

observation. 

Comparing  the  right  and  left  panels  of  each  figure  also  indicates 
that  TP I was  present  under  both  memory  support  and  no  memory  support 
conditions.  A failure  to  find  any  reliable  three  way  interaction 
among  instructional  sequence,  type  of  posttest  item,  and  testing  con- 
dition (F  < 1.00,  df  = 0/84 , p > .20)  among  sequence,  problem  format 

a • (r  - 2 79  dF  = 1/96,  p a .100)  nor  among  sequence, 

and  testing  condition  IF  - A /y,  ar  *■/  , £ 

/r  t l nn  df  = 2/192,  p > .20)  indicates 
content  and  testing  condition  (F  < 1.00,  d*  zn.  , £ 

that  the  attempt  to  alter  the  structural  differences  between  the  in- 
structional  sequences  was  not  successful. 
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Open-book  testing  seems  to  have  had  very  little  effect  on  either 
the  amount  or  the  structure  of  problem  solving  performance.  The  fact 
that  the  test  followed  learning  almost  i»ediately , and  that  the  formula 
was  on  the  blackboard  for  all  Ss  may  have  reduced  the  impact  o.  open  . o 
testing.  Apparently,  Ss  in  the  no  memory  support  condition  were  sole 
to  generate  problem  solutions  quite  well  with  only  their  existing  know- 
ledge and  the  formula  on  the  blackboard.  In  any  ease,  the  present 
results  do  indicate  that  structural  differences  are  resilient  at  least 
within  this  small  range  of  stress  manipulation , and  that  the  attempt 
to  force  similiar  kinds  of  memory  processing  failed  to  alter  evidence 
for  pre-established  differences  in  the  structure  of  learning  outcomes. 


CHAPTER  III 


EXPERIMENT  II 

Experiment  II  was  intended  to  replicate  and  extend  the  results  of 
Exper iment  I . 

Method 

Experiment  II  was  the  same  as  Experiment  I except  that  all  Ss  re- 
ceived the  BAG  order1 ng  of  booklet  parts  (instead  of  the  ABC  ordering) 
and,  during  the  test,  half  of  the  Ss  were  required  to  go  on  to  the 
next  card  every  90  sec  (Time  Stress  Condition)  and  half  were  allowed 
to  go  at  their  own  rate  as  in  Experiment  I (No  Time  Stress  Condition). 
In  Experiment  II,  no  Ss  received  memory  support  during  testing. 

As  in  Experiment  I,  nine  Ss  served  in  each  cell  of  a 2 x 3 x 2 
design  with  the  factors  being  instructional  sequence  (Sequence  E and 
Sequence  G), amount  of  instruction  (Amount  I,  II  and  III),  and  testing 
condition  (time  stress  and  no  time  stress).  The  108  Ss  were  recruited 
rom  a pool  of  University  of  Michigan  students  who  had  volunteered  to 
participate  in  psychological  experiments  at  the  Human  Performance 
Center  for  pay. 

Because  of  the  change  in  ordering,  Ss  receiving  Amount  I studied 
the  introduction  section  and  '"o inf  probability  section;  Ss  given 
Amount  II  had  the  introduction  followed  by  ~oint  probability  and  then, 
combinations,  and  Ss  given  Amount  III  received  all  four  sections  in 
the  order:  introduction,  -joint  probability,  combinations,  binomial 

probability. 
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Results  and  Discussion 

in  Experiment  II,  »i*  S.  failed  to  receive  a score  of  seven  or  more 
on  the  pretest,  three  Ss  indicated  direct  familiarity  with  the  material 
in  the  teaching  booklets,  and  four  failed  to  follow  direction, 
data  for  these  Ss  were  eliminated  from  the  experiment  and  new  Is  were 
run  in  their  places.  The  transfer  test  performance  was  scored  and 
analysed  as  in  Experiment  I.  As  in  Experiment  I,  there  was  no  reliable 
difference  in  overall  performance  between  the  two  treatment  group. 

(r  = 1.80,  df  = 1/86,  £_  > .18). 


rhe  Effect  of  Ordering 

A variable  that  was  changed  from  Experiment  I to  Experiment  II 
was  the  ordering  of  the  parts  or  sections  in  the  instructional  booklets, 
ror  example.  Amount  I contained  information  about  an  introduction  and 
combinations  in  the  ABC  ordering  of  Experiment  I but  Amount  I contained 
information  about  an  introduction  and  joint  probability  m the 
ordering  of  Experiment  II.  Some  indication  of  the  effect  of  ord 
and  the  respective  importance  of  the  combinations  and  ]omt  probability 
sections  is  provided  by  comparing  performance  across  experiments,  al- 
though  an  interpretation  of  these  data  is  made  more  difficult  by 
fact  that  the  two  experiments  were  not  run  concurrently  nor  under  the 

same  testing  conditions. 

The  overall  performance  with  Amount  I,  Amount  II,  and  Amount 
for  Ss  in  Experiment  I and  Experiment  II  is  given  in  Table  1. 
experiments  a significant  effect  due  to  amount  of  instruction  was 
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table:  i 

PROPORTION  CORRECT  RESPONSE  BY  AMOUNT  Of 
INSTRUCTION  TOR  EXPERIMENTS  I AND  II 


Amount  of  Instruction 

Experiment  I 

Experiment  II 

Control 

.10 

- 

Amount  I 

.38 

.25 

Amount  II 

.40 

.34 

Amount  III 

.46 

.43 

obtained  (for  Exp.  I:  F_  = 4.47,  df  = 2/96,  £ < .025;  for  Exp.  II: 

r = 22.10,  df  = 2/96,  £ < .001).  As  can  be  seen,  however,  a major 
difference  is  that  £s  in  Experiment  I showed  relatively  good  performance 
after  Amount  I and  very  little  improvement  from  Amount  I to  Amount  II, 
while  Ss  in  Experiment  II  showed  relatively  poor  performance  after 
Amount  I and  very  much  improvement  from  Amount  1 to  Amount  II. 

Anparently , the  combinations  section  (introduced  .n  Amount  . oi 
Experiment  I and  Amount  II  of  Experiment  II)  was  much  more  important 
in  increasing  performance  than  the  join*  probabiliuv  section  ( introduce*, 
in  Amount  TT  of  Experiment  I and  in  Amount  I of  Experiment  II).  Perhaps 
*N>  concept  of  combinations  is  less  Intuitive  or  less  familiar  than 
the  concert  of  'o'n*  rrobability;  but  whatever  the  reason,  the  present 
study  indicates  that  in  teaching  the  concept  of  binomial  probability 
the  most  important  component  to  teach  is  the  concept  of  combinations. 

The  ordering  of  presentation,  however,  apparently  had  little  or  no 
effect  on  final  outcome. 
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Development  of  Structural  Differences^ 

As  in  Experiment  I and  as  can  be  seen  in  the  right  panels  of 
Figures  7,  8,  and  0,  the  characteristic  patterns  of  TPI  are  present, 
suggesting  that  the  final  learning  outcomes  of  Ss  in  Sequence  r and 
Sequence  G are  structurally  different.  Some  information  about  how 
these  structural  differences  develop  over  the  course  of  learning 

is  also  provided  by  Experiment  II. 

Again,  special  attention  should  be  paid  to  whether  TPI  is 
at  all  points  in  learning  (as  found  in  Experiment  I)  and  whether  hot,, 
treatment  groups  perform  at  equal  levels  at  eaoh  point  in  learning  (as 
found  in  Experiment  1).  The  even  growth  of  learning  outcomes  for  the 
two  instructional  groups,  accompanied  by  a gradual  emergence  of  TPI 
would  provide  support  for  the  notion  that  Ss  in  different  groups  are 
simply  adding  more  and  more  of  different  kinds  of  information.  Either 
early  differences  in  the  apparent  amount  of  learning  displayed  by  the 
two  groups  that  disappear  by  the  end  of  learning,  or  a constantly 
observable  TPI,  or  a combination  of  the  two  would  suggest  that  Ss 
are  assimilating  the  material  to  different  cognitive  sets  throughout 

learning. 

Figure  7 shows  the  performance  of  the  two  instructional  groups  by 
problem  format  et  each  of  three  points  in  learning.  The  two-way  interaction 
between  sequence  and  format-in  which  Sequence  F Ss  excel  on  t-rormat 
and  Sequence  G Ss  perform  better  on  S-format  items-is  reliable  (F  = 21.  ‘ ' . 
df  = 1/96 , £ < .001)  again  suggesting  a structural  difference  m what 

is  learned  by  Ss  in  the  two  treatment  groups. 


The  sequence  by  amount 


quence 


r 


3'! 


interaction  is  manifested  in  the  fact  that  Sequence  G outperforms 
Sequence  F for  both  formats  after  Amount  I but  evens  out  to  the  usual 
TP I after  Amount  II  and  III.  Reliable  amount  by  format  (F  = U-5*. 
df  = 2/96,  p < .001),  amount  by  format  by  content  (F  = 3.4-j,  :f  - - *-•  . 
p < .125),  and  sequence  by  amount  by  format  .>y  ^o.-.e...  ’ 

df  = 4/192,  d < .001)  interactions  support  the  observable..  — 
the  combinations  section  (Amount  II)  helps  most  on  near  transrer  *-em, 
(P- format)  in  the  content  area  just  covered,  especially  for  Sequence  : 
Ss,  and  adding  the  final,  binomial  section  (Amount  III)  helps  most  on 
near  transfer  items  (F- format)  in  the  content  area  just  coverea, 
expecially  for  Sequence  G Ss  (see  Table  2). 


TABLE  2 


PROPORTION  CORRECT  RESPONSE  FOR  TWO  INSTRUCTIONAL 
GROUPS  BY  PRC  LEM  FORMAT  AND  CONTENT  FOP.  THREE 
AMOUNTS  OF  INSTRUCTION— EXPERIMENT  II 


Problem 

Content  and 

Format 

Instructional 

Sequence 

Instruction 

C-Content 

J-Content 

B-Content 

S 

F 

S_ 

F 

S_ 

p 

I 

.07 

.24 

.41 

.17 

.19 

.12 

G 

I 

.11 

.23 

.54 

.56 

.17 

.21 

F 

II 

.53 

.14 

.49 

.24 

.38 

.34 

G 

II 

.32 

.44 

.42 

.36 

.20 

.18 

F 

III 

.61 

.22 

.54 

.34 

.42 

.39 

G 

III 

.42 

.46 

.54 

.44 

.45 

.24 

i 


r 
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Although  the  inclusion  of  specific  content  material  was  important 
(especially  for  near  transfer  items)  under  both  instructional  methods, 
it  seems  that  Sequence  G Ss  were  developing  a structure  that  was  far 
'I  inore  capable  of  "adlibir.g"  when  the  assimilation  of  essential  content- 

material  was  incomplete,  i.e.  , after  only  Amount  I was  given.  The 
broad  assimilative  set  that  is  made  up  of  propositional  knowledge, 
apparently  used  by  Ss  m Sequence  j,  could  be  responsible  for  their 
ability  to  solve  problems  not  specifically  dealt  with  in  the  teaching 
booklet.  These  results  do'  not  suggest,  however,  that  Sequence  G 
Ss  do  not  require  presentation  of  specific  content  material;  the  huge 
increase  in  performance  on  F- format  items  by  Sequence  G Ss  especially 
from  Amount  II  to  Amount  III  clearly  indicates  that  presentation  oc 
content  material  is  important  especially  foi  near  transfer  performance 
in  both  treatment  groups. 

In  addition,  the  same  pattern  of  TFT  can  be  observed  at  each  of 

/ three  points  in  learning,  although  the  interaction  is  not  disordinal 

t 

after  Amount  I largely  due  to  the  poor  performance  of  Ss  in  Sequence  T . 

The  failure  to  obtain  a reliable  three-way  interaction  among  sequence, 

m 

format  and  amount  (F  = 2.49,  df  = 2/96,  £ > .100)  allows  us  to  retain 
-he  hypothesis  stated  in  Experiment  I that  structural  differences  begin 
iuite  early  and  do  not  change  much  throughout  learning.  However,  due 
to  differences  in  the  breadth  of  assimilative  sets  used,  lack  ot 
specific  content  material  is  more  detrimental  for  Sequence  F Ss. 

j 


i 
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Figure  8 shows  the  performance  of  the  two  instructional  groups  by 
problem  typ<->  at  each  of  three  points  in  learning.  Although  Sequence  F 
Sr  performed  better  on  F-type  problems  while  Sequence  G Ss  performed 
better  on  Q-  and  U-type  problems  as  was  found  in  Experiment  I , the 
two-way  interaction  between  sequence  and  type  failed  to  reach  a 
statistically  significant  level  (£  = 1.63,  df  = 4/384,  £<  .150). 

An  investigation  of  the  marginally  significant  three-way  interactions— 
sequence  by  type  by  content  (£  = 2.14,  df  = 8/768,  d_  < .50)  and 
sequence  by  type  by  format  (F  = 2.40,  df  = 4/384,  n_  < . 050)— indicates 
that  the  sequence  by  type  interaction  was  strongest  for  8-content  and 
F- format . 

Since  TPI  is  complicated  by  content  and  format,  and  is  not 
statistically  significant  in  this  case,  there  is  little  ooint  in  trying 
to  locate  where  TPI  begins;  however,  there  is  no  evidence  that  the 
pattern  of  TPI  is  influenced  by  the  amount  of  instruction.  The 
failure  of  the  sequence  by  amount  by  type  interaction  to  reach  statis- 
tical significance  (£  = 1.17,  df  = 3/384,  ^ > .200)  is  consistent  with 
the  results  of  Experiment  I indicating  no  structural  change  in  how  Ss 
in  the  two  instructional  groups  encoded  material  over  the  course  of 
learning. 

An  interesting  fact,  however,  is  that  Sequence  3 is  superior  to 
Sequence  F on  all  problem  types  after  Amount  I but  they  tend  to  even 
out  after  Amount  IT  and  III.  A reliable  sequence  by  amount  interaction 
(£  = 3.30,  df  = 2/06,  £ < .050)  verifies  this  observation  and  permits 


uence 


0 

IT  p 

•o  a.  a, 
a>  >.  o 
1 t < p 

a p i 
a . i -~- 

10  •.  I U 

a a (1)  o 
r:  in  rH  •*  i 

P p .a  4 < 
O ci  ,p  a 


■ , t ■ c j c> 

1 1 I ni  p 

i , i<  'O' 

U (l)  a 

ST  «’  lh 

11  V i in  io  Q) 

J5T  .a  c m a. 

a a 

V*  P a P I 

“ O 0)  cv 

T '*  i Uh  M i 

O :0  •’  J 

a;  p r. 

a.  qj  m m 

• •>  0)  p 

4 ' P a 

1x0  0) 

M (n  H 

o m n)  xi 

■H  0)  It) 

-P  0)  C P 

? r.  <U 

P +J  a li 

, , P.  pm 

1 1 I m a c 

#>  >>  a m n) 

□_  .o  p n>  c 

x 0)  P p 

>“  m tn  P<  ' 

P<  (1)  0) 

r—  p p p <u 

1 o p.  p. 

P a>  >i 
til  p T)  a 
^ 0)  i 

I | >i  6 P> 

I I I nJ  h P 

, g x:  o -P 

1 o u;  ta  P 

— r*  •-!  p m m 

fO  a o C 

“ o p m - 

O ? ^ 

fi  03  a at 
f r a m ' hh 

“ m m m 

A C .a  a;  c 

• -<  u a,  n) 

m >i  P 
p ,n  a a 


o 

rr: 

a) 

nJ 

0 

[ « 

r:  • 

■H 

U \ 

CD  1 

'd 

a) 

1 

<D 

• 

/ — *N 

l 

(/) 

M 

j-i 

LlI 

r. 

o 

M 

(C 

•H 

a> 

4-J 

cl 

o. 

w 

4 J 

( — 1 
•H 

C 

• r4 

'>- 

CD 

<d 

G 

• H 

G 

,nJ 

’•Li 

4-> 

H 

4 J 

O 

CD 

V— ✓ 

c. 

0J 

CD 

P. 

O 

(/^ 

1 S 

U 

O 

X 

w 

1 

a 

>> 

4-J 

(D 

Qi 

UJ 

o 

I 

r« 

1 

U-< 

CD 

f-l 

at 

. -J 

c 

o 

0 

•H 

U-. 

m 

ca 

•H 

V 

U 

(/) 

(/^ 

C 

c 

m 

o 

or 

2 

■2 

o 

•H 

p 

a 

a: 

a- 

o 

4-» 

W 

rH 

rH 

U 

U 

■ CL 

U 

CL 

C 

•r4 

o 

iu 

►J 

'w' 

4h 

43 


the  claim  that  adding  the  combinations  section  (Amount  II)  helped 

Sequence  F Ss  more  than  Sequence  G Ss. 

, . 7 ai  df  = 8/384,  p < .001),  amount 

Reliable  amount  by  type  (r_  - 7.87,  ar  »/  • t 

, ,r  . , 71t  df  = 16.768,  o < .010), and  sequence  by 
by  type  of  content  (F_  = 2.74,  at  to. _ 

amount  by  type  by  content  <F  . 2.10,  « • «/"».**  •»«> 
suggest  that  adding  new  content  helped  most  on  direct,  "near-  transrer 
items  O-  and  T-type,  in  the  content  are,  just  covered  with  the  addition 
of  Amount  II  especially  helping  Sequence  F Ss  and  the  addition  of 
Amount  III  especially  helping  Sequence  G Ss  (see  Table  3).  Again, 
these  findings  are  consistent  with  the  notion  tnat,  when  °pe 
content  material  is  incomplete,  the  ability  to  use  a wide  band  of 
propositional  knowledge  already  existing  in  memory  can  benefit  the 
Sequence  G Ss  while  Sequence  r Ss  encode  material  in  a way  that  is 
far  more  dependent  on  encoding  specific  material  in  a narrow  band  or 
algorithmic  knowledge.  Again,  however,  the  importance  of  specific 
content  for  Sequence  G Ss  is  manifested  in  the  lump  in  near  transfer 

performance  (F-  and  T-type)  for  Amount  III. 

finally,  the  performance  of  the  two  instructional  groups  by  pro- 
blem content  at  each  of  three  points  in  learning  -a  shown  ...  r.gur- 
As  in  experiment  I.  reliable  TPi  suggests  structural  differences  were 

_ F o-  suDorior  on  3-content  and  Sequence  G 
obtained  with  Sequence  F os  superior  o 

suoerior  to  C-  and  d-conte„t  items  (r  - U.«.  « ’ 2‘192’  * * 

Again,  the  sequence  by  amount  interaction  is  manifested  in  the 

fact  that  Sequence  G outperformed  Sequence  F for  all  content  areas 


r 
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after  Amount  I hut  evened  out  after  Amount  II  .-id  III.  Again,  reliable 
amount  by  content  (£  = 7.68,  df  = 4/192,  p < . 0 C 1 ) and  sequence  by  amount 
by  content  (37  = 2.62,  df  = 4/192,  p_  < .050)  interactions  suggest  that 
adding  extra  sections  helped  most--as  might  be  e>;pected--on  tost  items 
about  the  content  just  covered  and  especially  helped  Sequence  F Ss 
after  Amount  II  and  Sequence  G Sjs  after  Amount  III. 

As  in  Experiment  I,  the  same  general  pattern  of  TPI  seems  to  be 
present,  at  least  in  some  form,  at  each  of  three  points  in  learning. 
However,  unlike  Experiment  I,  a reliable  sequence  by  amount  by  content 
interaction  indicates  that  the  structural  differences  changed  as  the 
amount  of  instruction  was  Increased.  Apparently,  the  presentation 
order  used  in  Experiment  II  in  which  the  more  necessary  content  was 
not  presented  until  Amount  II , helped  focus  on  the  disproportionate 
importance  of  specific  content  for  incomplete  structures  of  Sequence  F 
Ss  relative  to  Sequence  G Ss. 

One  interpretation  that  is  consistent  with  the  analysis  of 
accuisition  in  terms  of  different  assimilative  sets  established  early 
in  learning  is  that  Sequence  F Ss  simply  had  less  to  work  with  after 
Amount  I— i.e.  , very  little  content  and  mainly  algorithmic  knowledge— 
while  Seauence  G Ss  had  activated  a broad  range  of  existing  propo- 
- • * • cr,a i v- iow' ec^e  , woful  in  inventing  solutions  in  tne  absence  or 
specific  informat'' on.  However,  the  fact  that  performance  jumpec.  on 
near  transfer  items  (B-content)  for  Sequence  G Ss  with  addition  of 
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I 
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Amount  III  again  points  to  the  importance  of  specific  content  for  an-  i 

swering  specific,  near  transfer  problems. 

I 

Resilience  of  Structural  Differences 

This  study  also  provides  some  information  about  the  resilience  of  f 

TPI  under  varying  testing  conditions.  Jr.  Experiment  I,  the  variable 

i 

of  memory  support  during  testing— a sort  of  stress  relief— failed  to 
produce  any  major  change  in  the  structural  differences  among  learning 
outcomes  and  only  slightly  influenced  overall  performance.  Experiment 
II  used  the  variable  of  time  stress  during  testing — as  a sort  of 
stress  evoker--in  another  attempt  to  disrupt  both  the  qualitative 
(or  structural)  and  quantitative  (or  overall)  features  of  the  perfor- 
mance of  S_s  who  had  acquired  different  cognitive  structures. 

Figure  10  gives  the  performance  of  the  two  instructional  groups 
by  problem  format  for  the  stress  and  no  stress  conditions.  A reliable 
overall  effect  due  to  stress  ( F_  = 12.5,  df  = 1/96,  £_  < .001)  is 
manifested  in  the  observation  that  the  curves  in  the  right  panel  are 
shifted  down  from  those  in  the  left  panel.  However,  as  can  be  seen 
in  comparing  the  two  panels,  the  structural  differences  as  manifested 
by  the  usual  sequence  by  format  interaction  (TPI)  seem  to  be  present 
both  with  and  without  stress;  the  failure  to  obtain  reliable  stress 
by  format  (_T  < 1.00,  df  = 1/96,  p_  > .20)  or  sequence  by  stress  by 
format  interactions  (_F  < 1.00,  df  = 1/96,  p_  > .20)  suggests  that 
there  is  no  evidence  that  stress  had  any  effect  on  the  structure  of 
learning  outcomes. 
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Figure  11  shows  the  performance  of  the  two  instructional  groups 
by  problem  type  for  the  time  stress  and  no  time  stress  conditions.  As 
can  be  seen,  ana  as  is  indicated  by  a reliable  stress  effect  (F_  = 12. L ., 
df  = 1/96,  p < .001)  but  no  reliable  stress  by  type  (F_  = 2.13,  = 11 '1 

p > 1.00)  or  sequence  by  stress  by  type  (F  < 1.0C,  cr  = K/ 06-, 
interaction,  test  stress  generally  had  the  effect  of  reducing  ov^ra-x 
performance  for  both  instructional  groups  and  for  alt  types  or  tc-.it 
problems.  The  structural  differences  between  the  two  instructional 
groups,  though  not  reaching  statistical  significance,  do  not  seem 
altered  by  the  introduction  of  test  stress  and  there  is  no  statistically 
reliable  evidence  that  stress  had  anything  but  an  overall  quantitative 
effect  on  performance  in  this  case. 

Figure  12  gives  the  performance  of  the  two  instructional  groups 
by  problem  content  for  the  time  stress  and  no  time  stress  conditions. 

As  with  problem  type  and  problem  format,  a reliable  overall  effect  due 
to  stress  can  be  observed  in  the  present  case  with  the  curves  xn  the 
right  panel  simply  shifted  down  from  those  in  the  left  panel,  again, 
the  structural  differences  between  the  two  instructional  groups  is 
clearly  present  under  both  stress  and  no  stress  conditions , and  the 
failure  to  obtain  reliable  stress  by  content  (£  < 1.00,  df  = 2/192, 
p •'  .20)  or  sequence  by  stress  by  content  (F_  < 1.00,  df  = 2/192,  g_  > . 2 
interactions  provides  no  evidence  that  stress  had  any  effect  on  the 
structure  of  learning  outcomes. 
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As  in  Experiment  I,  three  separate  tests  of  the  "resilience  question 
allowing  for  the  possibility  of  TP I under  one  testing  condition  but  not 
another,  were  conducted  and  failed  to  produce  this  result.  These  finding 
give  some  information  about  the  effect  of  stress  on  problem  solving  tha*' 
requires  a pre-learned  rule.  Apparently,  stress  may  have  an  overall  in- 
hibitory effect  on  the  amount  of  performance,  but  there  is  no  evidence 
that  stress  had  any  effect  on  the  quality  of  performance.  The  encoding 
process,  i.e.,  the  assimilative  set  into  which  the  rule  is  embedded, 
seems  to  be  the  major  determinant  of  the  structure  of  problem  solving 
performance  regardless  of  the  amount  of  stress  during  testing.  The 
amount  of  stress  seems  to  influence  only  the  absolute  level  of  perfor- 


mance in  this  case. 


CHAPTER  IV 


SUPPLEMENTAL  STUDIES 

In  addition  to  the  two  main  experiments,  two  smaller,  supplemental 
studies  were  conducted.  Tne  supn_er.er.ual 

tiona.1  materials  and  procedui-es  as  the  main  studies,  tut  va.meu  T-— 
testing  situation  in  order  to  provide  more  information  about  tne 
resilience  and  development  of  differences  in  learning  outcomes. 

Supplemental  Study  I 

One  study  focused  on  retention  performance  in  an  attempt  to  test 

• c 4.u„  differences  established  by 

the  endurance  over  time  of  the  structural  airrein.ee 

different  instructional  sequences. 

Method 

Nine  Ss  received  the  Sequence  F,  Amount  III,  Order  ABC  booklet  an, 
nine  other  Ss  received  the  Sequence  G,  Amount  III.  Order  ABC  booklet. 

The  30-item  transfer  test  »as  given-with  no  memory  support  and  no  time 

stress — two  days  later. 

Results  and  Discussion 

The  performance  of  the  two  instructional  groups  by  problem  format , 
by  problem  type,  and  by  problem  content  Is  shown  in  Figure  13.  As  car, 
be  seen,  the  two  day  retention  interval  does  not  seem  to  have  destroyed 
the  structural  differences  in  learning  outcomes  as  indicated  by  TPI. 

In  partial  replication  of  previous  findings.  Sequence  F Ss  excelled  on 
near  transfer  Itecs  such  as  F-type , T-type , F-format  and  B-content  while 
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Sequence  G excelled  on  far  transfer  items  such  as  U-type,  S-format, 
and  C-  and  J-content. 

As  in  the  main  studies,  an  analysis  of  variance  revealed  nc  sig- 
nificant difference  between  the  groups  in  overall  conformance , and 
found  ??I  for  type  (F  = 3.53,  df  = -/•.>-,  p *-  .125)  and  7?I  for  format 
(_F  = 5.60,  df  = 1/16,  < -050)  to  be  at  statistically  reliable  levels. 

The  sequence  by  content  interaction  failed  to  reach  significant  levels 
(£  = 2.09,  df  = 2/30,  o_  > .10);  however,  this  may  be  a reflection  of  the 
low  number  of  Ss  involved.  A significant  three-way  interaction  among 
sequence,  type  and  format  (F  = 5.41,  df  = 4/64,  p < .001)  indicates 
that  the  sequence  by  type  interaction  was  much  stronger  for  F- format 
items  than  for  S-format  items.  As  with  the  memory  support  and  time 
stress  variables,  there  was  r.o  strong  evidence  that  the  retent icr. 
interval  altered  the  structure  of  learning  outcomes. 

SuDolemental  Study  II 

■ . ■ ..  ,-h  . ■ ■■ 

The  other  supplemental  study  used  a modified  "method  of  reproduction" 
and  questionnaire  in  order  to  assess  S_' s judgment  of  what  was  important 
or  what  was  supposed  to  be  learned  at  each  of  three  points  in  learning 
for  the  two  instructional  groups. 

Method 

S.'x  £s  each  were  presented  with,  either  the  Sequence  F,  Amount  I, 

Order  ABC  booklet;  the  Sequence  F,  Amount  II,  Order  ABC  booklet;  the 
Sequence  F,  Amount  III,  Order  ABC  booklet;  the  Sequence  G,  Amount  I, 
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Order  A3C  booklet;  the  Sequence  G,  Amount  II,  Order  ABC  booklet;  or  the 
Sequence  G,  Amount  III,  Order  ABC  booklet.  All  So  were  then  given  an 
Immediate  retention  test  and  questionnaire.  The  test  was  to  write  down, 
with  no  memory  support  or  time  stress,  what  had  been  in  the  teaching 
urogram  as  if  £ were  trying  to  teach  it  to  another  S coming  in  for  the 
next  session. 

The  traditional  method  of  reproduction  was  modified  in  that  S was 
encouraged  to  "make  sense"  out  of  the  material  as  if  he  were  explaining 
what  he  had  just  learned  to  someone  who  did  not  already  know  it,  rather 
than  to  reproduce  the  material  word  for  word  as  given.  It  was  hoped 
this  procedure,  following  Piagetian  (Piaget,  1969)  techniques  with  children, 
would  provide  some  rudimentary  information  about  how  £ stored  the  content 
material  at  each  point  in  learning.  In  addition,  S.  was  asked  to  make 
up  three  test  items  to  cover  the  material  he  had  just  written. 

The  questionnaire  was  designed  to  assess  S_'s  interpretation  of 
the  motives  of  the  author  of  the  teaching  booklet,  i.e.  , to  assess  S_' s 
ability  to  pick  up  the  cues  in  the  teaching  booklet  concerning  what 
should  be  learned.  Sixteen  questions  were  constructed,  each  trying  to 
get  at  whether  S_  saw  his  task  as  (1)  learning  how  to  use  the  formula 
and  the  mechanical  steps  involved,  or  as  (2)  learning  what  the 
-ormula  means  and  understanding  the  component  concepts. 

Representative  questions  are  given  below: 

Pro-Calculating/Anti-Understanding:  Based  on  my  experience  with 

the  teaching  booklet  I would  say  that  the  formula  does  not  necessarily 
have  to  make  sense;  all  you  have  to  do  is  learn  how  to  use  it. 
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Anti-Calculating/Pro-Understanding:  To  use  the  teaching  program 

to  best  advantage  you  have  to  spend  time  thinking  about  how  each  concept- 
in  the  formula  relates  to  what  you  already  know . 

Subjects  were  asked  to  rate  their  agreement-disagreement  on  a 
6-point  scale,  although  for  purposes  of  analysis  1 , 2 or  3 were  counted 
as  disagree  and  4,  5 or  6 were  counted  as  agree. 

Results  and  Discussion 

The  protocols  from  each  C were  coded  for  number  of  words  and 
number  of  symbols, with  each  operator,  each  number  and  each  formal  notation 
character  counting  as  a symbol  (e.g.  , iil  counts  as  2 symbols;  15/2  counts 
as  3 symbols).  The  test  items  suggested  by  S_ were  coded  for  their  type, 
format, and  content.  A questionnaire  score  was  obtained  by  summing  the 
number  of  pro-calculating  (or  anti-understanding)  agreements  and  pre- 
understanding (or  anti-calculating)  disagreements  and  dividing  by  the 
total  number  of  questions. 

Table  4 shows  the  average  number  of  words  , the  average  number  of 
symbols, and  the  average  number  of  both  words  and  symbols  given  at  each 
point  in  learning  by  Ss  in  the  two  instructional  groups.  Separate 
analyses  of  variance  were  performed  on  these  data  yielding  some  pre- 
liminary information  about  how  S stores  the  material  and  S_' s ability 
to  detect  the  emphasis  of  his  teaching  booklet  at  each  of  three  points 
in  learning.  The  protocols  show  that  Ss  in  Sequence  F used  signifi- 
cantly more  symbols  overall  (F_  = 12.97,  df  = 1/30,  < .005)  and 

significantly  fewer  words  overall  (F_  = 9.25,  df  = 1/30,  p_  < .005)  in 
explaining  what  was  taught  than  Sequence  G Ss. 
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TABLE  4 


AVERAGE  NUMBER  OF  ELEMENTS  IN  REPRODUCTION  FOR  TWO 
INSTRUCTIONAL  GROUPS  AMD  THREE  AMOUNTS  OF 
INSTRUCTION— SUPPLEMENTAL  STUDY  II 


Average  Number  of  Words 


Instructional 

Sequence 

Amount 

of  Instruction 

Average 

I 

II 

III 

F 

110 

152 

243 

168 

G 

259 

270 

206 

247 

Ave. 

184 

215 

225 

Average  Number  of  Symbols 

Instructional 

Sequence 

Amount 

of  In 

struct ion 

Average 

I 

II 

III 

r 

95 

137 

190 

157 

G 

111 

107 

88 

102 

Ave. 

10  3 

147 

139 

Average  Number  of  Words  and 

Symbols 

Instructional 

Sequence 

Amount 

of  Instruction 

Average 

I 

II 

III 

t 

205 

339 

433 

326 

G 

370 

385 

293 

350 

Ave . 

287 

362 

363 



One  L inclination  is  that  So  were 

sensi 

tive  to  the 

emphases  of  their 

"CrDC-ct'-Vc  teaching  booklets.  Science  - my  foster  the  attitude  that 
,hat  ls  to  be  learned  is  the  mchanics  of  calculating  with  the  formula, 
;.e.,  the  building  of  internal  connections  (hence  many  symbols),  while 
ice  G may  foster  the  attitude  that  what  is  to  be  learned  is  a 


Sequence 
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conceptual  understanding  of  what  the  components  of  the  formula  mean, 
i.e.,  the  building  of  external  connections  (hence  many  words).  Apparently, 
Ss  were  able  to  identify  these  emphases  and  use  them  as  a key  to  encoding 

the  material. 

A more  striking  finding  is  that  as  tne  amount  o±  _r.s >.r-c u-o., 
creased,  both  the  number  of  words  and  tne  number  of  symbols  output  by 
Ss  in  Sequence  F increased  while  the  output  by  Ss  in  Se^uer...  .j 
about  the  same  or  went  down.  Reliable  sequence  >y  amount  interactions 
for  words  (F  = 5.10,  df  = 2/30,  £ < .025),  for  symbols  (£  = 5.63, 
df  = 2/30,  £ < .010)  and  for  both  (£  = 6.91,  df  - 2/30,  £ < .00j) 
support  this  observation.  It  appears  that  Sequence  F Ss  were  adding 
more  and  more  discrete  pieces  of  information  while  Sequence  G Ss  were 
forming  a tighter,  more  streamlined  structure- less  dependent  on  material 
presented  by  E because  more  already  stored  Knowledge  could  be  used. 

The  results  concerning  test  items  suggested  by  S also  provide  some 
information  about  what  S thought  was  important  or  the  goal  of  learning. 
Table  5 shows  the  average  number  of  F-  and  T-type  (as  opposed  to  Q yp  ) » 
F-format  (as  opposed  to  S-format),  and  B-content  (as  opposed  to  L-  and 
J-content)  problems  given  at  three  points  in  learning  by  Ss  in  tne  two 
instructional  groups.  Separate  analyses  of  variance  were  performed. 

Subjects  in  Sequence  F suggested  significantly  more  F-  and  T-type 
(F  = 10.80,  df  = 1/30,  £ < .005)  and  F-format  (F  = 12.25,  df  = 1/3., 
p < .005)  items  than  Ss  in  Sequence  3,  indicating  an  emphasis  on 
using  the  formula  on  direct,  near  transfer;  conversely,  Sequence  Ss 
offered  signf icant.y  more  Q-type  and  S-format  items,  indicating  an 
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TABLE  5 

AVERAGE  NUMBER  OF  TEST  ITEMS  SUGGESTED  BY  METHOD  AND 
AMOUNT  OF  INSTRUCTION— SUPPLEMENTAL  STUDY  II 


Average  Number 

of 

F-Format  Items 

Instructional 

Amount  of  Instruction 

Average 

Sequence 

I II 

III 

r 

1.50  1.50 

1.67 

1.56 

r> 

o 

.33 ._17_ 

.00 

.17 

Ave  • 

.92  .83 

.33 

Average  Number 

of 

B-Content  Items 

Instructional 

Amount  of  Instruction 

Average 

Sequence 

I II 

III 

F 

2.17  2.83 

2.67 

2.56 

G 

2.67  2.33 

2.50 

2.50 

Ave. 

2.42  2.58 

2.58 

Average  Number 

of 

F-  and  T-Type  Items 

Instructional 

Amount  of  Instruction 

Average 

Sequence 

I 11 

III 

F 

1.17  2.67 

2.67 

2.17 

G 

.83  1.33 

1.33 

1.17 

Ave. 

— 1 

1.00  2.00 

2.00 

eThasis  on  loss  direct,  far  transfer  applications.  The  fact  that  there 
vere  no  significant  roc  -once  by  amount  Interactions  for  format  (F_  < 1.00, 
df  = 2/30,  o > .20),  for  content  (F_  < 1.00,  df  = 2/30,  £_  > .^0)  nor  for 
type  (F  = 1.20,  df  = 2/30,  £_  > .20)  suggests  that  S_  can  pick  up  and 
retain  the  emphasis  of  his  booklet  equally  well  after  Amount  I,  II  or  III. 
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Finally,  Table  6 shows  the  proportion  of  pro-calculating/anti-^ 
mderstanding  response  on  the  questionnaire  given  by  Ss  in  the  two  in- 
jtructional  groups  at  three  points  in  learning.  As  can  be  seen, 

Ls  revealed  by  ar.  analysis  of  variance.  Sequence  • 

. statement-.  and  more  disagreeao-e 

-ore  agreeable  with  pro  cau.u.Ji*.>D 

oro -understanding  statements  than  Sequence  G Ss  (F  = l4-97’ 

* . / ^ t nn 

L<  .001).  However,  no  reliable  sequence  by  amount  interact  .or.  - ' ’ 

df  = 2/30,  d > .20)  was  obtained  thus  suggesting  that  .ne  overa- 
difference  between  the  groups  occurred  consistently  at  eacn  point  ... 
learning.  Again,  support  is  provided  for  the  claim  that  S can  interpret 
retain  the  emraasis  or  expectation  of  his  teaching  booklet,  even 


only  after  Amount  I or  II. 


TABLE  6 


PROPORTION  "PRO-CALCULATING"  OR  "ANTI -UNDERSTANDING" 

RESPONSE  ON  QUESTICWAIPE,  BY  METHOD  AND  amount 


i.iim’T’.T  ovnnv  TT 


Instructional 

Sequence 

Amount  of  Instruction 

Average 

I 

II 

III 

.62 

.04 

.56 

.60 

r 

G 

.39 

■ 38 

.48 

.42 

Ave. 

.51 

.51 

.52 

CHAPTER  V 


SUMMARY  AMD  CONCLUSIONS 


Development  of  Structural  Differences 
In  Experiment  I,  Experiment  II,  and  the  supplemental  studies  there 
was  clear  evidence  that,  of  those  Ss  presented  with  the  entire  lesson 
(i.e.,  Amount  III),  Ss  in  different  instructional  groups  had  acquired 
learning  outcomes  that  differed  in  a qualitative  or  structural  way. 

This  inference  was  based  on  a pattern  of  results  which  partially  repli- 
cated three  earlier  studies  (Mayer  & Grecno,  1972;  Egan  & Greeno , 1373; 
Greeno  & Mayer,  in  prep.):  Ss  in  Sequence  F and  Sequence  G performed  at 

fairly  equal  levels  overall,  hut  TP.T  was  displayed  in  that  Sequence  F 
Ss  excelled  on  "near"  transfer  items  such  as  F- format,  F-type , and 
C-content  while  Sequence  G S_s  excelled  on  "far"  transfer  items  such 
as  S- format,  Q-  and  U-type,  and  C-  and  J-content. 

The  final  learning  outcomes  of  the  two  groups  were  characterized 
in  terms  of  internal  and  external  connections  with  Ss  in  Sequence  l 
acquiring  structures  with  strong  internal  connections  (e.g. , P is  linked 
to  R by  the  operation  of  exponentiation)  and  weak  external  connections 
(e.g.,  P is  related  to  general  experience  with  probability  of  an  event), 
and  Ss  in  Sequence  0 acquiring  structures  with  weak  internal  connections 
and  strong  external  connections.  This  kind  of  analysis  seems  to  be 
useful  in  describing  differences  in  cognitive  structure  that  allow 
Seaucnce  F to  excel  on  direct  plug-in-to-the-formula  problems  and 
allow  Seaucnce  0 to  excel  on  more  interpretative  tasks  such  as  recognizing 
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unanswerable  problems,  understanding  how  the  formula  relates  to  storv 
problems,  or  dealing  with  logical  components  of  the  formula. 

A new  goal  of  the  present  set  of  experiments  was  to  generate  some 
useful  information  concerning  hew  these  structural  differences  develop 
over  the  course  of  learning,  ar.c  especia_*v  , - 

two  descriptions  of  the  acquisition  process  ace..i  *“°rc  a??'r uP-*OL“. 
an  acquisition  process  in  wmen  more  ana  ~.ci  e °- 

material  (e.g.,  internal  links  vs.  external  links)  is  being  adaec  to 
the  cognitive  structures  of  different  S_s , or  an  acquisition  process 
which  the  content  material  is  being  embedded  within  different  areas  of 
existing  knowledge  (e.g.,  algorithmic  knowledge  vs.  propositional 
knowledge)  by  different  Ss. 

The  two  main  studies  provide  empirical  support  for  the  second 
idea,  that  different  instructional  sequences  activate  different  kinds 
of  existing  knowledge  (i.e.,  different  receptive  sets)  quite  early  in 
learning,  and  that  structurally  different  learning  outcomes  result  from 
content  material  being  encoded  within  the  context  of  these  different 
"sets"  throughout  learning.  The  concepts  of  algorithmic  and  propositional 
knowledge  were  found  useful  in  describing  the  difference  in  S s ' 
assimilative  sets:  Sequence  F seems  to  activate  only  a narrow  band 

of  experience  with  mathematical  operations  and  calculating  wita  a 
formula  (fitting  the  description  of  algorithmic  knowledge),  while 
Sequence  G seems  to  activate  a much  wider  band  of  experience  witn 
probability  situations  (fitting  the  description  of  propositional 
knowledge ) . 
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Empirical  support  for  the  proposal  that  the  structure  of  learning 
outcomes  is  determined  both  by  the  content  material  (in  this  case,  the 
same  mathematical  rule  for  all  Sp)  and  the  kind  of  existing  knowledge 
to  which  it  is  assimilated  (in  this  case,  either  algorithmic  or  pro- 
positional  knowledge)  comes  from  several  findings.  In  Experiment  I, 
there  was  no  evidence  that  TPI  (and  by  inference,  the  structure  of 
learning  outcomes)  was  any  different  after  Amount  I,  Amount  II  or 
Amount  III.  If  Ss  had  been  adding  more  and  more  of  different  kinds 
of  material  under  the  two  instructional  methods,  one  would  have  expected 
a weak  TPI  after  Amount  T that  got  stronger  after  Amount  II  and 
strongest  after  Amount  III  since  each  added  section  should  add  more 
of  different  kinds  of  content  to  Ss*  cognitive  structure.  However, 
che  fact  that  TPI  was  constant,  i.e.,  equally  strong  and  observable, 
across  all  three  amounts  of  instruction  is  consistent  with  the  idea 
that  different  assimilative  sets  were  evoked  quite  early  in  learning 
and  used  throughout  learning  to  encode  incoming  information.  Thus 
although  the  overall  level  of  performance  was  increased  for  both  in- 
structional groups  as  more  material  was  presented,  the  differences  in 
how  i4-  was  structured  were  constant  throughout  learning. 

The  results  oc  Experiment  II  seem  to  replicate  Experiment  I except 

Sequence  F Ss  oer formed  reliably  worse  than  Sequence  6 Ss  after 
Amount  I;  the  two  groups  performed  at  equal  levels  of  overall  performance 
for  more  amounts  of  instruction  (as  in  Experiment  I).  Apparently,  the 
ordering  of  instruction  in  Experiment  II  allowed  for  a substantial  amount 


of  content  material  to  be  lacking  in  Amount  I.  The  fact  that  the  lack  of 
specific  material  hurt  Sequence  F far  more  than  Sequence  G is  consistent 
with  the  idea  that  Sequence  G Ss  had  access  to  a wide  range  of  already 
existing  knowledge  that  could  be  used  in  inventing  solutions  to  problems 
not  yet  taught"  while  Sequence  F us  aac  to  depend  on  a much  narrower, 
more  specific  kind  of  knowledge.  However,  the  importance  of  aoeci""  c 
content  for  Sequence  G S_s  is  indicated  by  a large  increase  in  "near 
transfer"  performance  with  the  addition  of  Amount  III.  Apparently, 
the  activation  of  propositional  knowledge  in  of  itself--though  helpful 
in  creating  solutions  to  far  transfer  items — is  not  sufficient  for 
good  problem  solving  performance  and  especially  needs  the  inclusion 
of  specific  content  for  solving  straightforward  near  transfer  items. 
Although  beyond  the  scope  of  the  present  study,  it  remains  for  further 
studies  to  investigate  whether  it  is  possible  to  construct  a teaching 
sequence  that  insures  the  advantages  cf  both  of  the  present  teaching 
booklets--i.  e. , both  good  near  and  far  transfer. 

Finally,  the  results  of  Sunplemental  Study  II  show  that  Ss  were 
easily  able  to  recognize  the  differences  in  emphasis  of  the  two  booklets. 
This  inference  is  supported  by  the  fact  that  Sequence  F £s  more  often 
l^eport  (on  a post-experi  nental  questionnaire)  the  purpose  of  the  lesson 
as  memorizing  how  to  use  a rule  and  Sequence  G Ss  report  the  purpose 
as  understanding  what  the  rule  means,  and  the  fact  that  these  differences 
do  not  reliably  change  from  Amount  I to  Amuunt  II  to  Amount  III. 

Secondly , the  fact  that  Sequence  F Ss  gave  more  symbols  in  their 
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reproduction  protocols  and  Sequence  G gave  more  words  also  indicates 
an  ability  not  only  to  recognize  but  to  reproduce  differences  in  the 
emphases  of  the  teaching  booklets.  Another  interesting  finding,  con- 
sistent with  the  foregoing  description  of  the  acquisition  process,  is 
that  the  reproduction  protocols  of  Sequence  F Ss  got  longer  and  longer 
as  the  amount  of  instruction  was  increased,  but  the  length  of  protocols 
of  Sequence  G Ss  fell  or  stayed  about  the  same  across  all  amounts  of 
instruction.  Apparently,  Sequence  F Ss  were  far  more  dependent  on 
adding  specific  pieces  of  information  to  cognitive  structure  while 
Sequence  G "saved  space"  by  integrating  the  information  into  existing 

structures. 

Resilience  of  Structural  Differences 
There  were  two  separate  experimental  attempts  to  disrupt  the  char- 
acteristic patterns  of  TPI  by  varying  the  amount  of  stress  during  testing 
and  forcing,  it  was  assumed,  Ss  with  structurally  different  learning 
outcomes  to  process  their  cognitive  structures  in  the  same  way.  Both 
attempts  failed,  suggesting  that  post-learning  manipulations  aimed  at 
S’?  infernal  processing  style  do  not  have  the  same  effect  on  outcome 
performance  as  do  such  manipulations  during  learning.  Apparently,  once 
-he  problem  solving  rule  is  encoded,  test  stress  can  influence  the 
absolute  level  of  performance  but  has  negligible  effect  on  the  structure 
of  problem  solving  performance. 

For  example , In  Experiment  I Ss  tested  under  the  memory  support 
condition  (a  sort  of  stress  relief)  performed  at  a slightly  higher  overall 
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level  relative  to  no  memory  support  S_s , but  also  exhibited  a pattern  of 
TPI  indistinguishable  from  Ss  tested  under  no  memory  support  conditions. 

In  Experiment  II,  Ss  tested  under  time  stress,  although  showing  a relative 
decrement  in  overall  performance,  also  exhibited  a pattern  of  TPI  in- 
distinguishable from  Ss  tested  under  no  time  stress  conditions.  finally, 
Ss  in  Supplemental  Study  I gave  evidence  of  the  typical  patterns  of  TPI 
after  a two  day  retention  interval,  although  there  were  no  control  groups 
in  this  study  upon  which  to  base  comparisons. 

The  effect  of  stress  on  the  application  of  a pre-learned  rule  to 
problem  solving  situations  seems  to  be  mainly  quantitative  (Experiment  II) 
and  in  some  cases  not  even  that  (Experiment  I).  There  was  some  evidence 
that  stress  relief  allowed  better  performance  on  the  harder,  "far"  trans- 
fer problems  (Experiment  I)  but  stress  affected  both  kinds  of  cognitive 
structures  about  the  same  in  this  respect.  However,  the  qualitative 
differences  in  learning  outcomes  were  not  strongly  influenced  by  stress 
or  retention  intervals,  and  this  finding--while  requiring  further  study — 
seems  to  demand  the  tentative  conclusion  that  the  structure  of  learning 
outcomes,  once  established,  may  be  a fairly  permanent  feature  of  S.'s 
cognitive  life. 

Relation  to  Discovery  Learning  and  Creative  Problem  Solving 

These  results  also  give  some  hints  about  the  prerequisites  for  dis- 
covery learning  and  creative  problem  solving.  For  the  kind  of  teaching 
whose  goal  is  creative  problem  solving,  such  as  displayed  by  Sequence  G, 
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Amount  I Ss  in  Experiment  II  (i.e.,  inventing  solutions  with  very  little 
specific  content  material  having  been  given),  it  is  clear  that  a sub- 
stantial bank  of  what  has  been  called  "propositional  knowledge"  must  be 
available.  For  S_s  who  do  not  have  a well  integrated  set  of  general 
experiences  in  the  required  area  (e.g.  , in  this  case,  in  probability 
of  events),  it  seems  that  attempts  to  achieve  learning  outcomes  that  can 
support  creative  problem  solving  will  fail.  This  is  so  because  the  kind 
of  learning  outcome  that  supports  creative  problem  solving  (e.g.,  as 
displayed  by  Sequence  G 3s)  is  acquired  by  embedding  the  problem  solving 
rule  in  a bank  of  the  appropriate  propositional  knowledge.  Instead  of 
demanding  that  Ss  who  lack  the  appropriate  prerequirite  knowledge 
learn  a given  problem  solution  rule,  and  thereby  insuring  either  no 
learning  or  a very  specific  kind  of  encoding,  it  seems  a better  educa- 
tional practice  to  first  provide  £s  with  the  necessary  prerequisite 
concepts.  Previous  findings  (Egan  6 Greeno , 197  3;  Greeno  5 Mayer, 
in  prep.)  which  show  individual  differences  in  specific  prerequisite 
knowledge  to  be  far  more  important  for  "discovery"  learning  methods 
-yan  for  "rule"  learning  methods  support  this  argument. 

In  short,  the  results  seem  to  indicate  that  for  those  kinds  of 
learning  whose  goal  is  a quick,  efficient  ability  to  perform  a given  set 
Qf  ooe rations  (e.g..  arithmetic  operations)  only  a narrcn  set  of 
existing  knowledge  is  necessary,  but  for  learning  that  supports 
creative  problem  solving  (e.g.,  reconstructing  a procedure  for  new 
problems)  the  need  to  make  sure  S possesses  the  prerequisite  knowledge 
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is  essential.  These  results  suggest  that  discovery  teaching  to  Ss  who 
lack  the  appropriate  propositional  knowledge  will  not  result  in  discovery 
learning  or  creative  problem  solving,  and  may  result  in  no  learning  at  all. 

limitations 

ine  generality  or  tnese  findings  xs  limited  by  a number  of  factors 
including  the  pecularities  of  the  binomial  as  the  to-be-taught  rule. 

The  concept  of  binomial  probability  is  expressed  as  a fairly  complicated 
and  seemingly  arbitrary  mathematical  rule  made  up  of  a set  of  conceotual 
variables  (with  potential  meaning  in  terms  of  Sj s existing  propositional 
knowledge)  and  a set  of  mechanical  operators  (with  relevance  for  a narrow 
range  of  experience  with  arithmetic  calculations).  Thus  it  seems  that 
the  conclusions  concerning  the  binomial  are  most  likely  to  apply  in  the 
learning  of  problem  solving  procedures  which  are  expressed  as  complicated 
rules  and  which  can  be  structured  in  memory  in  terms  of  meaningful 
variables  or  in  terms  of  algorithmic  operations.  A main  instructional 
variable  in  such  cases  is  the  degree  to  which  the  potential  "meanings" 
of  the  component  variables  are  emphasized  versus  the  degree  to  which 
the  mechanical  operations  are  emphasized.  For  example,  in  an  unpublished 
study  using  this  instructional  variable  in  conjunction  with  teaching 
Bayes 1 Theorem  evidence  for  the  expected  structural  differences  was 
obtained  (Stiehl,  1973).  It  seems  clear,  however,  that  more  studies 
using  a wider  range  of  problem  materials,  as  well  as  different  Ss , and 
long-term  experimental  designs  would  be  useful. 


APPENDIX  A 


COMPLETE  TEACHING  PROGRAM  TEXTS  FOP.  SEQ  ,'CNCE  F AND  G 

Sequence  F - Part  I (Introduction) 

P(r|n)  = C(N,R)  x PR  x (1-P)N_R 

This  is  called  the  binomial  formula.  It  can  be  used  to  find  the 
probability  that  something  called  "success"  occurs  R times  in  N trials. 

The  symbol  P(R|N)  stands  for  the  probability  of  R successes  in  N 
trials.  R is  the  number  of  successes  and  N is  the  number  of  trials. 

For  example,  if  R = 2 and  N = 4,  P(r|n)  is  the  probability  of  2 successes 
q trials.  We  might  roll  a die  4 times  and  define  success  as  rolling 
a 5 or  6.  If  R = 2 then  P(r|n)  is  the  probability  of  rolling  a 5 or  6 
twice  in  4 rolls. 

To  find  the  value  of  P ( R j N ) we  need  to  find  three  values.  The 
formula  is : 

F(R|N)  = C(M ,R)  x PR  x (1-P)N'R. 

Thus,  P ( R | N ) is  the  product  of  three  terms: 

(1)  C(N,R) 

(2)  PR 

(3)  (1-P)N_R 

You  will  need  to  remember  how  to  find  the  value  of  each  of  the  three 
terms  :n  the  formula  for  P(n'r).  The  first  term  is  C(N,R).  As  we  will 
see  later  the  value  of  C(N,R)  depends  on  N— the  number  of  trials--  and  on 
p__the  number  of  successes.  The  second  term  in  the  formula  is  P . R is 
the  number  of  successes  and  P is  the  probability  of  success . Ihe  tnird 
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term  in  the  formula  is  (l-P)^-?'. 
N-R  is  the  number  of  failures. 


1-P  is  the  probability  of  failure  and 


Sequence  F - Part  II  (Combinations) 

As  we  said  earlier,  rhp  ... , * . . 

’ L°  ri--”£  out  what  ?(R,;0  equals 

to  calculate  the  value  of  p/bi  ^ 

vauue  or  UN,R).  To  fma  tne  value  of  C(N,R)  use 

the  formula: 


C(M,R)  = — — ijj 

R!x(N-R) ; 

( Remember  that  the  symbol  stands  for  tutorial.  To  calculate 

read  »N  factorial"  multiply  N times  K-l  times  N-2  and  so  on  down  to  1. 
That  is,  !)•  = N(!l-l)(H-2)(H-3)  ...  (1).  For  example  5,  . 5 „ „ „ s „ 2 

1 - 120  or  3!  = 3 x 2 x 1 = 6.  Also  note  that  by  definition  1!  = 

1 and  0!  = 1.  ) 


To  find  the  value  of  C(N,R): 

(a)  Take  N 

(b)  Make  it  N*  *[*N, 

(c)  Take  R ..R 

Cd)  Make  it  R!  

(e)  Take  N minus  R 

(f)  Make  it  (N-R)!  (N-R)! 

(g)  Multiply  R!  times  (N-R)!  R!(N-R)! 

(h)  Divide  R!  ( N- R ) ! into  N!  N! /R!  (N-R ) ! ) 

As  an  example  of  the  formula  C(N,R)  = N!/(R!  x (N-R)!),  think  of  R 
and  N = 4.  Th  -n. 


C(N,R) 


4! 

1 ! 3! 


4x3x2xl 

Ix3x3xl 


4. 


To  find  the  value  of  0(4,1)  the  steps  are 


(a)  M = 4 

(b)  M!  = 4x3x2x1  = 24 

(c)  R = 1 

(d)  R!  .:  i 

(e)  N-P  i 3 

(f)  (N-R)  = 3 x 2 x 1 = 6 

(g)  R! (N-R) ! = 1 x 3 x 2 x 1 = 6 

(h)  N! / ■' R i (N-R ) ! ) = 4 x 3 x 2 x 1/1  x 3 x 2 x 1 = 24/6  - 4 
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As  another  example  if  we  define  successes  as  5 or  6 and  roll  a die 
five  times  getting  three  successes,  we  have  N = 5 and  R = 3,  and  the 
value  of  C(N,R)  is: 


C ( N , R ) = 
You  can  check 


5 ! _ 5x4x3x2xl 

3!x2!  3x2xlx2xl  = 10, 

this  answer  by  carefully  going  through  each 


formula  for  C(N,R). 


step  of  the 


Sequence  F - Part  Ilia  (Joint  Probability-PR  Term) 

Recall  that  P(r|n)  = C(N,R)  x PR  x (1-P)N“R.  You  know  how  to  find 
C(N,R) . 

R 

To  find  P we  must  find  P,  the  probability  of  success.  In  general 
P is  the  proportion  of  trials  on  which  a success  would  occur  if  there 
•were  a very  large  number  of  trials.  For  example,  if  success  is  defined 
as  rolling  a 5 or  6 on  a die,  then  P = 1/3. 

To  find  PR,  simply  take  P and  raise  it  to  the  Rth  power.  (Note 
that  P = P and  P3  = 1. ) To  find  the  value  of  PR: 

(a)  Take  P 

(b)  Raise  it  to  the  Rth  power. 

For  example,  if  P = 1/3  and  R = 3,  then  P*  = (1/3)3  = 1/27.  To  find 
R 

fne  value  of  P the  steps  are: 

(a)  P = 1/3 

(b)  ?*  = (1/3)  = 1/27. 

As  another  example,  if  success  is  rolling  a 5 or  6 on  a die  and  the  number 

P O 

of  successes  is  two,  then  P = 1/3,  R = 2 and  P‘  = (1/3)  = 1/9.  The 

p 

steps  to  finding  P ' are  just  to  take  P and  then  raise  it  to  the  Rth  power. 
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N-R 

Sequence  F-  Part  Illb  (Joint  Probability- (1-P ) Term) 

Remember  the  formula  .is  P ( R | N ) = C(N,R)  x PR  x (1-P)^  “.  You  now 
know  how  to  find  C(N,R)  and  P . 

?.j  _ p 

To  find  the  value  of  (1-P)‘  ' there  are  three  steps: 

(a)  Take  P P 

(b)  Subtract  P from  one  1-? 

(c)  Take  H N 

(d)  Subtract  R from  N N-R 

(e)  Take  1-P  and  raise  it  to  the  (N-R)th  power  ..(1-P)1 

For  example,  if  success  is  a 5 or  6 then  P = 1/3  and  1-P  = 2/3.  If 
there  are  five  trials  and  two  successes  then  N = 5,  R = 2,  and  N-R  = 3. 
In  this  case. 


(1-P)N  R = (1  - l/3)b  2 = ( 2/ 3 ) 3 = 8/27. 

The  probability  of  success  is  P and  the  probability  of  failure  is 
1-P.  Similiarly,  the  number  of  successes  is  R and  the  number  of  failures 
is  (N-R).  In  our  example,  the  probability  of  failure  is  2/3  and  the 
number  of  failures  is  3.  Thus, 


(1-P)N_R  = ( 2 / 3 ) 3 = 8/27. 

Remember,  if  P = 1/3,  N = 5,  and  R = 2 then  the  steps  to  finding  the 
value  of  (1-P)^  “ are: 


(a)  P = 1/3 

(b)  l-P  = 2/3 

( c ) N = 5 

(d)  N-R  = 3 „ 

(e)  (1-P)  = (2/3)  = 8/27. 


Sequence  ~ - Part  IV  (Binomial  Probability) 
ftow  we  will  summarize  what  you  have  learned.  The  binomial  formula 


. o: 


= c(:c,?-)  x f?  x (i-p)"  ' - 

You  find  the  value  of  P(RftO  in  four  stages: 

(1)  r irst  i find  £(N,R)  using  the  formula,  C(N,R)  = * J>N"‘) ! } ‘ 

):  ..dX-  find  dust  take  ? and  raise  it  to  the  Rtn  power. 

:j'  ;*  find  (l-P)*'”".  Subtract  P from  one . to  get  1-P,  then 
subtract  P from  N to_get  N-R»  and  then  raise  1-:  to 

(4)  When^’ou  have  found  the  values  of  the  three  terms,  rmci  their 
product . This  rives  P(F»,  the  probability  of  P.  successes 

in  SJ  trials. 

example,  suppose  that  P = 3/4,  N - ' “nd 

_ . . ,,  - o and  F = 2 so  C(!i,R)  = 31/(2!  x 1!)  = 3 

(1)  First,  find  C(..,;).  - - a *“_•  _?  - (3/U)2  - 9/I6. 

;:9X:’  p.0)s-r.  i-f  - i/u  and  h-r  = 1 so  (.-?)••  • = <*/-> 

(3)  ..ex  , - j.nu  p - 3/4  is : 

(4)  T^e  rrobahilitv  o^  2 successes  m 3 trials  w.th  . 

P(R'jiO  = 3 x.  3/16  x 1/4  = 27/64. 

re  is  another  example.  If  success  is  defined  as  rolling  an  even  number 
3 die,  the  probability  of  t *ee  successes  in  five  trials  is  ?(*.'.!)  witn 
= 1/2,  R = 3 and  N = 5. 


(1) 

(2) 

(3)  ::ex 

(4) 


,„t  c(V  ■)  "as  M = 5 and  R = 3.  C(N,R)  = 51/(3!  x2!  > 
.rstvU,  » pP  s (1/2)3  = 13. 

;*i;  U :'1’2 \J »-a  = 2 «,  u-p>»-«  ■ w*r  - w- 

. (?'•!)  = 13  x 1/8  x 1/4  = 10/3.  - - J-U* 


Fecuer.ce  3 - Part  I ( introduction )_ 
important  concepts  are  trials  and  outcomes*  A trial  is  something 
we  do.  The  outcome  of  a trial  is  just  what  happens  on  the  trial. 

-here  are  several  possible  outcomes  of  a trial. 
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For  example,  imagine  rolling  a die.  Rolling  the  die  is  a trial. 

The  possible  outcomes  are  the  numbers  1,  2,  3,  4,  5,  and  6.  The  number 
that  comes  up  when  we  roll  the  die  is  called  the  outcome  of  the  trial. 

Another  important  concept  is  success.  We  define  a success  as  cr.e 
or  more  of  the  possible  outcomes.  Then  if  one  of  those  outcomes  occurs, 
we  have  a success. 

In  rolling  a die  we  could  decide  to  ;efino  success  as  rolling  a 5 
or  a 6.  Then  if  5 or  6 comes  up,  a success  has  occurred. 

We  can  define  success  in  different  ways.  A success  might  be 
rolling  an  even  number.  Then  if  the  outcome  is  2,  4,  or  6 we  have  a 
success.  Or  a success  might  be  not  -4.  Then  success  outcomes  are  1, 

2,  3,  4,  5,  and  6 . 

The  next  concept  to  learn  is  the  probability  of  success.  The 
probability  of  success  is  the  proportion  of  trials  on  which  a success 
would  occur  if  there  were  a large  number  of  trials.  For  example,  if 
a success  is  an  outcome  of  5 or  6 in  rolling  a die,  then  the  probability 
of  success  is  1/3.  This  is  so  because  we  expect  a 5 or  6 to  come  up  on 
about  one-third  of  the  times  the  die  is  rolled. 

In  other  words,  the  probability  of  a success  is  the  number  of 
success  outcomes  divided  by  the  total  number  of  outcomes  (including 
success  outcomes)  if  all  the  outcomes  have  an  equal  chance.  If  a success 
is  5 or  6 and  all  the  possible  outcomes  have  an  equal  chance,  then  pro- 
bability ot  success  is  2/6  or  1/3  because  there  are  two  possible  outcomes 


with  six  outcomes  in  all. 
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the  other  hand,  a failure  occurs  whenever  success  does  not  occur 
For  example,  if  we  say  a success  is  either  of  the  outcomes  5 or  G in 
rolling  a die,  then  the  outcome  1,  2,  3,  or  4 could  be  a failure.  The 
probability  of  failure  is:  Probability  of  success  subtracted  from  one. 

1^  success  is  rolling  5 or  6 , probability  of  success  is  1/3  and 
probability  of  failure  is  2/3. 

The  next  concept  to  learn  is  a sequence.  A sequence  is  what 
happens  when  we  conduct  several  trials,  one  after  the  other.  Suppose 
each  trial  is  rolling  a die  and  we  define  a success  in  some  way.  If 
we  roll  the  die  five  times  we  might  obtain  the  sequence  (failure, 
failure,  success,  failure,  success),  or  more  simply  (F,  F,  S,  F,  S). 

Any  sequence  has  a probability.  The  probability  of  a sequence 
is  the  product  of  the  probabilities  of  the  individual  events.  For 
example,  if  probability  of  success  is  1/3,  then  the  sequence  (success, 
failure,  success)  has  probability  (1/3 )x(2/3 )x(l/3 ) = 2/27.  The  sequence 
(F,  F,  S,  G,  F)  has  probability  (2/3)x(2/3)x(l/3)x(l/3)x(2/3)  = 8/243. 

We  let  the  number  of  trials  in  a sequence  be  symbolized  by  the 
letter  N and  the  number  of  successes  in  those  trials  is  called  R. 

The  number  of  failures  is  N-P.. 

R = number  of  trials 

R r number  of  successes 

V— “ nura  o?*'  or  * 1 ) ypo  9. 

For  example,  in  the  sequence  (S,  F,  G)  there  are  three  trials  and  two 
successes.  Therefore,  N = 3,  R = 2,  and  N-R  = 1. 
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Sequence  G - Part  II  (Combinations) 

As  we  said  earlier,  when  a trial  is  reseated  several  times  we  get  a 
sequence  of  outcomes,  consisting  of  a pattern  of  successes  and  failures, 
nut  different  outcome  sequences  car.  have  the  same  number  of  successes. 

For  example,  in  three  trials  we  can  have  two  successes  in  three 
different  ways:  (S,3,D,  (3,1,3),  and  ( F , , ). 

The  number  of  different  sequences  having  r.  successes  in  h trials 
is  called  the  number  of  combinations,  denoted  by  C(N,R).  Think  of  C(N,R) 

as  the  number  of  ways  R successes  can  occur  in  N trials. 

To  find  the  number  of  ways  P successes  can  occur  in  N trials  take 
’.I!  (read  "H  factorial")  divided  by  the  product  Pd  x ( M-R ) ! . (Remember 
that  "!"  means  take  the  number  before  it  times  itself  minus  one,  times 
that  number  minus  one,  and  so  on  down  to  one,  e.g.  , 5!  = 5x4x3x.2xl  = 120 

or  3!  = 3x2x1  = 6.  Note  that  by  definition  1!  =1  and  0!  = 1). 

Use  the  formula: 

ii ' . 

C(N,R)  = - ,■  777  - v.  = number  of  ways  R successes  can  occur  m N trials. 

R!x(M-R)! 


M!  _ N(N-1 ) (M-2 ) 1 

R ! x ( M- R ) ! ( R ( R - 1 ) ( R- 2 ) 1 )x(N-R ) ( ii-R-1 ) (N-R-2 ) 1 ) 

As  an  example  of  finding  C(N,R),  think  of  one  success  in  four  trials. 

There  are  foul-1  sequences:  (S,F,F,F),  (F,S,F,F),  (F,F,S,F),  (F,F,F,S). 

This  agrees  with  the  formula: 


C ( N , R ) 


M! 

R'x(N-R)! 


C( 4 ,1 ) 


4!  _ 4x3x2xl 

1 ! x3 ! = Ix3x2xl 
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If  we  define  success  as  5 or  6 and  roll  a die  five  times,  the  number  of 


ways  to  get  three  successes  is: 

C(H.R)  - C(5.3)  . ^ -S^ff-lO. 


As  a check  you  can  note  that  the  10  possible  sequences  are:  FFGSG, 

3FFSS,  SCFFS,  SSSFF,  FSFSS,  SFSFS,  SGFGF,  FSSFS,  SFGSF,  FGGGF.  The 
C ( N , R ) formula  is  just  a quick  way  of  finding  cut  how  many  ways  R 
successes  car.  occur  in  II  trials. 


Sequence  G - Part  III  (Joint  Probability) 

Now  you  know  how  to  find  the  number  of  different  sequences  having 

R successes  in  N trials.  In  order  to  find  the  probability  of  any  single 

sequence,  you  have  to  recall  that  if  a sequence  has  N trials,  then  the 

probability  of  the  sequence  has  N terms.  For  example,  if  probability 

of  success  is  1/3,  the  sequence  (S,F,F,F)  lias  probability  (l/3)x(2/3)x 

(2/3)x(2/3).  Note  that  N = 4 and  so  the  probability  has  four  terms. 

If  probability  of  success  is  1/3,  the  sequence  (S,F,S,G,F)  has 

probability  (l/3)x(2/3)x(l/3)x(l/3)x(2/3).  Again  N ? 5 and  the  number 

of  terms  in  the  probability  is  5.  Actually,  this  way  of  expressing  the 

3 2 

probability  is  the  same  as  (1/3)  x(2/3)  . Keep  in  mind  that  R = 3 
and  N'-R  = 2 for  this  sequence. 

In  the  sequence  (F,F,G ,S,F,F) , N = C,  R = 2,  N-R  = 4.  If 
ore’: ability  of  succor  is  1/5,  the  rrobability  of  the  sequence  is 

(4/5)x(4/5)x(l/5)x(l/5)x(4/5)x(4/5)  = ( 1/5)" x<4/5)4  = <l/5)Rx(4/5)“"R. 
Note  that  these  last  two  expressions  are  just  shorter  ways  of  expressing 
the  probability.  They  all  equal  256/15625. 
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The  probability  of  success  is  symbolized  by  the  letter  P.  The 

probability  of  failure  is  1-P.  For  exarrole,  if  a trial  is  rolling  one 

die  and  success  outcomes  are  5 or  6,  then  P = 1/3  and  1-P  = 2/3. 

P = probability  of  success 
1-?  = probability  of  ; allure 

The  probability  of  any  sequence  having  R successes  and  ..-a  fa-.r-.res 
is  P‘  x(l-P)“  For  example,  the  probability  or  the  sequence  (S,:,:,S,5) 
is  P3x(l-P)2.  bote  that  this  agrees  with  the  longer  version:  ? x (1-?) 

x (1-P)  x P x P.  If  P = 1/2  then  the  probability  of  the  sequence  equals 


(1/2 )3x( 1/2 )“  = 1/32.  Mete  that  this  agrees  with  the  longer  method  of 
multiplying  (l/2)x(l/2)x(l/2)x(l/2)x(i/2)  = 1/32. 

As  a quick  way  of  finding  the  probability  of  a sequence  use  the 
formula: 

r°x(l-F )'-2  = probability  of  P.  successes  and  N-R  failures  in  any 


; ingle  sequence 


(Mote:  By  definition  F~  = 1,  (1-P)  = 1,  P - P,  and  (1-P)  - )•) 


Sequence  G - Part  IV  (Binomial  Probability) 

Finally  you  will  learn  about  the  probability  of  R successes  in  M 
trials.  The* re  are  a number  of  sequences  having  R successes  in  N trials 
(that  is,  the  number  of  combinations).  Each  of  these  sequences  has  ...e 
same  probability:  PKx(l-P)‘ 

The  probability  of  R successes  in  N trials  is  the  probability  o: 
getting  one  of  the  sequences  in  the  set  of  sequences  having  R successes. 
For  example,  ifN=3andR=2,  there  are  three  possible  sequences: 
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(SSF),  (SFS),  (FSS).  If  P = 3/4,  each  sequence  has  probability  (3/4)“x 
(1/4 )X  = 3/64.  We  have  two  successes  in  three  trials  if  anv  of  the 
three  sequences  occurs. 

Going  on,  if  there  are  three  sequences  in  the  set  with  two  successes, 

and  each  sequence  has  probability  9/64,  then  the  probability  of  obtaining 

one  of  those  three  sequences  is  3 x 9/64  = 27/64.  We  know  that  the  number 

of  sequences  having  R successes  in  H trials  is  C(N,R).  Also,  the 

probability  of  each  such  sequence  is  P"x(l-P)‘  Thus  the  probability 

of  R successes  in  tl  ''rials  is: 

P !!-R 

C (II ,R)  x P'V.(l-P)  ' = probability  of  R successes  in  N trials. 

We  use  the  symbol  P(r|n)  to  stand  for  the  probability  of  R successes  in  I! 
trials.  This  gives  a formula  called  the  binomial  formula: 

?( R | II ) = C(M,R)xPRx(1-P)N_R. 

For  example,  the  probability  of  one  success  in  four  trials  is  denoted  as 
P(1 | 4)  since  R = 1 and  M =4.  If  P = 1/3,  then  P(l|4)  = C(4 ,1 )x(l/3 )Xx 
(2/3)3.  C(4  ,1)  = 4.  (l/3)1x(2/3)3  = 8/81.  So  P ( 4 1 1 ) = 4 x (8/81)  = 

32/81  or  .395.  Note  that  this  equation  is  just  a simple  wry  of  saying 
that  the  probability  of  R successes  in  N trials  equals  the  number  of 
oossible  sequences  with  R successes  in  N trials  times  the  probability 
of  anv  one  of  those  sequences. 


APPENDIX  3 


PROBLEMS  GIVEN  IN  30-ITEM  TRANSFER  POSTTEST 

Letters  in  parenthesis  after  each  number  indicate  problem  format,  type, 

and  content  respectively. 

1- (F,F,C):  ? = 1/2,  ::  = 3,  R = . What  is  C(N,R)? 

2- (F,T,C):  N = 32 , R = (2/3)  x N,  ? = 1/2  What  is  CO.'.R)? 

3- (F,L,C ) : C(N,R)  = 10,  R = 3 What  is  N? 

4- (F,Q,C) : Can  C(N,R)  be  smaller  than  R?  Car.  C(N,R)  be  smaller  than  M? 

5- (F,U,C):  N = 2,  R = 3,  P = 1/2  What  is  C(N,R)? 

6-  (S ,F,C ) : A coin  is  flipped  six  tines,  giving  a sequence  of  heads  and  tails. 

How  many  different  sequences  contain  two  heads  and  four  tails? 

7- (S,T,C):  If  a fair  die  is  rolled  4 times  and  the  number  of  successes  equals 

half  the  number  of  trials,  how  many  different  sequences  could  be 
generated? 

9- (S,L,C) : There  are  10  different  sequences  tnat  have  exactly  two  successes. 

All  the  sequences  have  the  same  length.  How  long  are  they? 

3-(S,Q,C):  If  a die  is  rolled  100  times  and  success  is  defined  as  a 1 or 

does  the  number  of  possible  sequences  with  47  successes  equal 
number  of  sequences  with  47  failures? 

10- (5,U,C):  In  flipping  a coin,  how  many  different  sequences  have  the  same 

number  of  successes  as  failures? 

P N-R 

11-  (F ,F,J ) : P = .75,  N = 0,  R = 4 What  is  P ' x (1-P)"  ? 

12- (F,T,J):  P = 3(  1-P ) , N = 6,  R = N-R  What  is  P*'  x (1-P)“  R? 

13- 0  , L,J):  PR  x (1-P)I<_K  = 1/2,  N = R What  is  P“? 

14-  ( F,Q, J ) : Can  P be  greater  than  1-P?  Can  1-P  be  greater  than  P? 

15- (F,U,J):  N = 5,  R = 2,  P = 3/2  What  is  Pr"  x (1-?)“  *'? 

16- (S,F,J):  One-tent.i  of  the  peanuts  in  a barrel  are  rotten.  If  you  take 

five  peanuts,  what  is  the  probability  that  the  first  four  are 
good  and  the  fifth  one  is  rotten? 


i 
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17-(S,T,J): 


A bag  has  a 
What  is  the 
blue? 


d and  blue  chips  with  twice  as  many  reds  as  blues, 
probability  of‘  picking  4 reds  in  a row  and  then  one 


no  fc  r tv  A large  iar  is  filled  with  red  and  black  marbles.  When  you  take 
18-(S,L»J) . A 1 g 1 ^ marbles  the  probability  of  having  only  red 

marbles  in  the  sample  is  1/64.  What  proportion  of  marbles  m 

the  jar  are  red? 


19- (S,Q,J): 

20- (S,U,J): 

21-  (F  ,F,B) : 

22- (F ,T,B): 

23- (F,L,B): 

24- (F,Q,B): 


. fair  coin  is  flipoed  six  times  with  the  following  outcome: 
or  less  than  1/2? 

When  a die  is  rolled  four  times  . what  is  t^P^bability  of  the 
sequence:  (success,  success,  failure,  failur.). 

N=4,R=3,P=.20  What  is  P(r|n>? 

n_r  = 2,  P = R/2,  N = 3 What  is  P<R|N>? 


P(r|N)  = .25,  F = I/**,  R = 1 ^at  is  M? 

Can  p(r|H)  be  greater  than  P?  Cm  MR|u)  be  lass  than 
?R  x (l-P)N"R? 


25- (F,U,B): 

26- (S,F,B): 


27-(S,T,B): 
29-(S,;j,B)  : 


2?-(S,Q,3) : 


= 4,  N = 5,  P = R-M  What  is  P(R|”)? 


n exactly  two  of  the  trials? 


die  is  rolled  six  times.  What  is  the 
tvrJnz  ud  twice  as  many  times  as  odds; 


probability  of  evens 


In  a game  you  toss  a com 
of  heads  in  the  sequence 
probability  of  winning  is 


four  times  and  you  win  if  the  number 
equals  a certain  number.  If  your 
6/16  what  is  your  winning  number. 


Ic  there  a difference  between  the 
rolled  at  once  both  come  u?^  6 and 
rolled  twice  comes  up  6 botn  times 


probability  that 
the  pro lability 


two  dice 
that  one  die 


30-(5,U,B): 


Suppose  that  two  people  out 
like  John  Wayne  movies.  If 
probability  that  two  people 


of  every  nine  in  a 
a sample  is  taken, 
in  the  sample  like 


certain  town 
what  is  the 
John  Wayne  movies? 
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